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CHAPTER  I 


INTRODUCTION 

Special  training,  more  specifically  contractor- 
conducted  special  training,  required  to  support  Air  Force 
systems  acquisition  programs  is  becoming  an  area  of 
growing  fiscal  concern.  This  concern  is  a  product  of  the 
requirements  for  more  sophisticated  and  thereby  more 
expensive  training,  the  effects  of  inflation,  and  the 
current  public  concern  for  defense  expenditures.  It  is 
estimated  that  USAF-contr actor  training  requirements  will 
exceed  $20  million  in  FY80  and  $33  million  in  FY81  (1) . 

Contractor-conducted  training  is  utilized  to 
upgrade  USAF  personnel  who  will  be  supporting  new  weapons 
and  support  systems  during  testing  and  subsequent 
deployment.  Delays  or  other  problems  in  the  training 
planning  can  result  in  cost  and/or  schedule  impacts  on  the 
acquisition  program.  A  recent  problem  in  this  area  has 
been  a  shortage  in  the  funds  available  for  purchasing 
necessary  contractor  training  (16;  28). 

Background 

To  complement  the  background  discussion,  the 
narrative  will  be  integrated  with  a  systems  approach  (18) 
to  enhance  the  reader's  understanding.  Several  subsystems 


will  be  developed  in  the  background  discussion.  Each  sub¬ 
system  will  incorporate  an  input,  a  process,  and  an  output 
as  illustrated  in  Figure  1.  At  the  end  of  the  background 
discussion,  the  subsystems  will  be  incorporated  into  an 
overall  system  diagram. 


Fig.  1.  Basic  System 

Special  training  is  defined  by  Air  Force 
Regulation  (AFR)  50-9,  Special  Training,  to  be  formal 
training 

.  .  .  designed  to  provide  experienced  military  and 
civilian  personnel  with  additional  or  upgraded  skill 
in  the  operation,  maintenance,  repair,  overhaul, 
setup,  and  checkout,  programming,  analysis,  software 
design,  engineering  aspects  of  Air  Force  equipment  or 
systems,  and  information  on  operational  techniques  and 
procedures  [24:2]. 

Major  command-identified  special  training  requirements  are 
satisfied  by  Air  Training  Command  (ATC)  through  utiliza¬ 
tion  of  existing  ATC,  USAF,  or  Department  of  Defense  (DOD) 
training  courses  or  by  purchasing  training  from  civilian 
contractors,  educational  institutions,  or  other  government 
agencies.  Four  types  of  special  training  are  defined  by 
AFR  50-9  as  follows: 


HI  pi"  ■  "P 
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a.  Type  1  .  .  .  .  factory  training  .  .  . 
established  to  qualify  Air  Training  Command  (ATC) 
instructors  and  to  provide  an  initial  cadre  of  skilled 
maintenance,  aircrew,  system  operator,  or  other  type 
personnel  required  by  the  major  commands. 

b.  Type  2.  Special  training  conducted  by 
ATC  instructors  normally  at  an  ATC  base.  This 
training  is  often  conducted  as  a  continuation  of, 
and  sometimes  concurrently  with  a  Type  1  special 
course  to  train  personnel  of  the  major  commands. 

[Type  3.  Resident  training  of  a  continuing 
nature  conducted  by  ATC  which  includes  basic, 
lateral,  advanced,  and  supplemental  courses.  These 
courses  are  identified  in  AFM  50-5,  USAF  Formal 
Schools  Catalog  (25),  and  are  not  included  in  AFR 

75^57] - 

c.  Type  4.  Special  training  provided  by  ATC 
Field  Training  Detachments  ...  or  mobile  training 
teams  (MTTs) . 

d.  Type  5.  Special  training  arranged  for  by  ATC 
which  is  conducted  by  other  US  Government  Agencies  or 
major  commands  other  than  ATC  [24:3]. 

Special  training  requirements  are  identified  by 
the  major  commands  via  Air  Force  Form  403,  "Request  for 
Special  Technical  Training,"  and  may  be  satisfied  by  one 
or  more  of  the  above  types  of  special  training.  Training 
requests  received  by  ATC  are  forwarded  to  the  appropriate 
System  Training  Manager  (STM) ,  who  may  be  located  at 
Headquarters  ATC  or  at  one  of  four  technical  training 
centers.  The  STM  determines  the  type(s)  of  training 
required  to  satisfy  the  request  (Figure  2) .  If  Type  1 
training  is  required,  the  STM  will  compute  an  estimated 
cost  for  the  training  and  assess  the  funding  priority  of 
the  program. 
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Pig.  2.  ATC  Selection  of  Training  Type 

When  special  training  requirements  are  in  support 
of  USAF  systems  acquisition  programs,  training  is  fre¬ 
quently  not  available  within  DOD  and  Type  1  training  must 
be  purchased.  This  training  is  then  used  to  meet  major 
command  initial  trained  personnel  requirements  and  fre¬ 
quently  forms  the  basis  for  follow-on  Type  2,  3  and/or  4 
training  programs  to  meet  future  trained  personnel 
requirements. 

In  accordance  with  AFR  50-9,  "Air  Training 
Command  has  been  delegated  Air  Force-wide  responsibility 
as  the  sole  purchaser  of  Type  1  training  [24:3]."  ATC  is 
responsible  for  surveying  and  screening  major  command 
training  requirements,  budgeting  for  Type  1  training,  and 
establishing  a  program  priority  system  for  the  control  of 
training  programs  within  funding  limitations  (24:7)  (see 
Figure  3). 


In  recent  years,  USAF  Type  1  training  require¬ 
ments  have  exceeded  ATC  funding  capabilities,  as  indicated 
in  ATC  correspondence  for  FY78  and  79.  In  a  1978  letter 
(28)  to  Deputy  Chief  of  Staff  (DCS) /Systems ,  Headquarters 
Air  Force  Systems  Command  (AFSC/SD) ,  and  DCS/Logistics 
Operations,  Air  Force  Logistics  Command  (AFLC/LO) , 
Brigadier  General  Vojvodich,  DCS/Technical  Training  (TT) 
for  HQ  ATC,  identified  a  shortage  of  funds  for  FY78  and 
requested  a  prioritization  of  training  requirements  by  the 
respective  commands.  Similar  letters  (16;  17)  were 
addressed  to  all  major  commands  in  FY79  by  the  Commander 
(CC)  and  Vice  Commander  (CV)  of  ATC  identifying  FY79 
shortages. 

This  shortage  in  training  funds  necessitated  a 
coordinated  effort  between  ATC  and  the  major  commands  to 
ensure  effective  and  efficient  utilization  of  the  limited 
funds.  FY79  funding  limitations  were  the  most  serious,  as 
expressed  by  General  John  W.  Roberts,  as  Commander  of  ATC, 
in  a  letter  to  the  commanders  of  all  major  commands: 

Earlier  this  year  we  advised  you  of  a  serious 
deficiency  in  contract  training  funds.  We  initially 
received  funding  in  the  amount  of  $5.1M  against 
MAJCOM-stated  requirements  of  $9.1M.  Our  funding 
level  was  subsequently  reduced  to  $3.1M.  The  end 
result  is  that  many  of  the  critical  training  require¬ 
ments  in  support  of  operational  systems  cannot  be 
funded  [16]. 


ATC  subsequently  received  supplemental  funding  in  July  1979 
in  the  amount  of  $3.0  million;  however,  this  was  still 
$3.0  million  below  FY79  requirements  (22). 

Of  the  $3.1  million  initially  available  for  Type  1 
training  in  FY79,  $1.1  million  was  identified  for  depot 
level  maintenance  support  training  for  AFLC  personnel  (8) . 
AFLC  minimum  requirements  exceeded  this  figure  by  $2.8 
million  as  identified  by  General  Bryce  Poe  II,  AFLC 
Commander,  in  an  impact  letter  to  General  Lew  Allen,  Jr., 
Chief  of  Staff  of  the  Air  Force  (13).  Impacts  for  various 
programs  identified  in  this  letter  included  delay  of  orga¬ 
nic  depot  capability,  a  need  to  contract  for  expensive 
contractor  support,  hazards  to  personnel  attempting  to 
operate  equipment  without  adequate  training,  idle  depot 
equipment,  and  slower  response  time  for  depot  support. 

In  response  to  the  funding  shortage  of  FY78  and 
FY79,  ATC/TT  and  ATC/CC  respectively  (28;  16)  requested 
that  all  major  commands,  including  AFLC,  provide  cost 
impact  statements  on  affected  command  programs.  These 
statements  were  used  as  an  additional  input  in  prioritiz¬ 
ing  training  requirements  to  ensure  that  limited  funds 
were  appropriately  allocated.  The  statements  were  also 
included  as  funding  justification  in  the  supplemental 
training  funding  requests  submitted  to  Air  Staff  by 


AFLC  and  ATC 


Problem  Statement 


As  a  result  of  a  shortage  in  training  funds  and 
inadequate  supplemental  funding,  AFLC  must  implement 
unplanned  and  unbudgeted  alternatives  to  satisfy  depot 
support  requirements.  Personal  interviews  with  HQ  AFLC 
personnel  from  Logistics  Management  and  Training  (4) , 
Resources  and  Management  Engineering  (9) ,  and  Employee 
Development  and  Training  (5)  and  HQ  ATC  correspondence 
from  Colonel  Robert  F.  Brodman,  Director  of  Systems 
Training,  to  the  Military  Education  and  Training  Division 
(HQ  AFLC/DPMTT)  (2)  provided  the  following  list  of  AFLC 
alternatives: 

1.  Delay  the  organic  depot  capability,  continue 
with  contractor  depot  support,  and  resubmit  the  training 
request  in  the  next  fiscal  year; 

2.  Contract  for  Contractor  Engineering  Technical 
Services  (CETS)  to  provide  on-the-job  training1  and  tech¬ 
nical  support  (23); 

3.  Fund  for  required  Type  1  training  by  providing 
obligation  authority  to  ATC  or  by  AFLC  training  contracts, 
the  latter  of  which  requires  waiver  from  AFR  50-9; 

^nder  CETS,  a  technical  representative  is 
assigned  to  the  depot  for  a  specified  period  of  time  to 
provide  informal  training  and  technical  guidance  as 
required  on  designated  equipment.  Training  may  include 
informal  classroom  instruction;  however,  it  does  not  pro¬ 
vide  the  depth  or  quality  of  training  provided  by  formal 
Type  1  classroom  training  (24:3;  23:1-1  to  1-2). 
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4.  Develop  and  implement  an  in-house  training 
program  to  qualify  depot  personnel. 

The  selection  of  an  alternative  by  AFLC  is  illustrated 
in  Figure  4. 

Determination  of  the  cost  impact  (opportunity 
cost)  of  implementing  alternatives  to  date  has  been  a 
reactive  process  in  response  to  requests  from  ATC.  Also, 
until  FY79  HQ  AFLC  did  not  typically  become  involved  in 
the  funding  process  as  the  logistics  centers  coordinated 
directly  with  ATC  (5).  Beginning  in  FY80,  all  training 
requirements  for  AFLC  logistics  centers  are  submitted  to 
ATC  through  HQ  AFLC.  Increased  headquarters  involvement 
in  the  planning  process  and  the  potential  for  future 
funding  problems  dictate  a  need  for  determining  cost 
impacts  at  earlier  stages  in  the  planning  process  by  per¬ 
sonnel  at  headquarters  level.  To  date,  however,  there 
does  not  appear  to  be  a  representative  model  available  to 
headquarters  personnel  which  relates  the  estimated  cost  of 
unfunded  training  programs  to  the  cost  impact  (opportunity 
cost)  to  AFLC  of  implementing  alternatives. 

Justification 

Interviews  with  training  planning  personnel  from 
the  Training  Programs  Division,  DCS/Manpower -Personnel,  HQ 
USAF  (1);  Aerospace  Systems  Division,  Systems  Training 
Division,  HQ  ATC  (12);  and  Employee  Development  and 


Training  Division,  HQ  AFLC  (5)  indicate  that  such  a  model 
would  provide  a  means  of  estimating  the  cost  impact  of 
unfunded  training  at  the  headquarters  level.  A  model 
would  enable  planning  personnel  to  estimate  cost  impact 
and  minimize  time-consuming  and  more  costly  impact  com¬ 
putations  by  AFLC  logistics  centers.  For  ATC  personnel, 
this  capability  would  provide  an  additional  input  to  the 
priority  system  used  in  allocating  Type  1  training  funds 
(see  Figure  5) .  For  AFLC  and  Air  Staff  personnel,  the 
model  would  provide  a  means  of  predicting  cost  impacts  and 
identifying  potential  problem  areas.  For  personnel  at 
ATC,  AFLC,  and  Air  Staff,  the  cost  impact  figures  could  be 
an  input  to  the  justification  for  supplemental  funding  for 
Type  1  training. 

The  problem  of  insufficient  Type  1  training  funds, 
although  not  a  new  problem,  appears  to  be  growing.  For 
FY80  Type  1  training  requirements  are  estimated  at  $26.0 
million  (22)  ,  which  includes  carry-over  of  unfunded 
requirements  from  FY79.  Associated  funding  for  Type  1 
training  for  FY80  is  currently  estimated  to  be  $11.2 
million;  the  estimated  shortage  being  $14.8  million.  Such 
a  shortage  will  demand  attention  at  all  levels  to  deter¬ 
mine  how  the  limited  funds  will  be  allocated  and  what 
the  impact  of  unfunded  training  programs  will  be.  The 
availability  of  a  valid,  respresentative  model  will  not 
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solve  the  funding  problem;  however,  it  would  provide  use¬ 
ful  inputs  to  the  planning  process. 


Scope 

This  research  was  conducted  with  primary  emphasis 
on  the  costs  of  the  first  and  second  alternatives  identi¬ 
fied  in  the  problem  statement.  The  cost  impact  to  AFLC 
of  funding  for  Type  1  training,  the  third  alternative,  is 
known  once  the  estimated  cost  of  training  is  determined. 
Information  was  also  gathered  when  available  on  the  cost 
of  in-house  training,  the  fourth  alternative;  however, 
in  many  cases  these  costs  were  difficult  to  distinguish 
from  the  day-to-day  operating  costs  of  the  logistics 
centers. 


Research  Objective 

The  objective  of  this  research  was  to  investigate  the 
relationship  between  the  estimated  cost  of  Type  1  training 
and  the  cost  of  implementing  unplanned  CETS  and/or 
continued  contractor  support,  hereafter  referred  to  as 
alternatives,  as  a  result  of  unfunded  training. 

Research  Propositions 

1.  There  exists  a  positive  linear  relationship 
between  the  estimated  training  cost  and  the  cost  to  AFLC 
of  implementing  alternatives. 


Discussions  with  AFLC  personnel  suggest  that 


alternative  costs  are  proportional  to  estimated  training 
costs,  therefore,  a  positive  relationship  is  proposed. 
Linearity,  or  at  least  piece-wise  linearity,  is  proposed 
to  provide  planning  personnel  with  a  representative  but 
easily  applied  model. 

2.  It  would  be  more  cost  effective  for  the  Air 
Force  to  provide  adequate  funds  to  ATC  to  satisfy  AFLC 
training  requirements  than  to  have  AFLC  implement  alterna¬ 
tives. 

Preliminary  research  indicates  that  alternative 
costs  are  greater  than  the  associated  estimated  training 
costs.  This  implies  that  it  would  be  more  cost  effective 
for  the  Air  Force  to  meet  ATC  budgetary  requests  to  sup¬ 
port  AFLC  training  requirements  than  to  have  AFLC  implement 
alternatives.  If  Proposition  1  is  concluded,  cost  effec¬ 
tiveness  could  be  determined  based  upon  model  output. 

Plan  of  the  Report 

The  presentation  plan  for  this  report  is  as 

follows: 

Chapter  I  includes  the  background  and  problem  state 
ment  followed  by  justification  for  the  study.  The  scope  of 
the  research  is  outlined  and  the  research  objective  and  pro 
positions  to  be  investigated  are  defined. 


Chapter  II  presents  the  research  methodology  includ¬ 


ing  definition  of  the  research  variables  and  description 
of  the  data  collection  and  analysis  plan.  The  chapter 
closes  with  a  listing  of  the  research  assumptions  and 
limitations . 

Chapter  III  provides  a  statistical  and  narrative 
summary  of  the  data  collected  from  the  APLC  Air  Logistics 
Centers  (ALCs) .  Findings  derived  from  personal  and 
telephone  interviews  related  to  (1)  the  ALC  responses, 

(2)  barriers  to  more  comprehensive  data  collection,  and 

(3)  FY80  training  funding  are  presented  and  discussed  with 
respect  to  the  research  propositions. 

Chapter  IV  presents  the  research  conclusions  and 
closes  with  recommendations  for  improved  fiscal  control 
in  the  area  of  training  funding  and  areas  for  further 
study. 


CHAPTER  II 


METHODOLOGY 

This  chapter  presents  a  description  of  the  data 
collection  and  analysis  procedures  used  to  investigate  the 
relationship  between  estimated  costs  for  unfunded  training 
and  the  cost  to  AFLC  to  implement  alternatives.  The  popu¬ 
lations  studied  are  defined  and  the  data  collection  plan 
is  described,  including  a  discussion  of  the  problems 
encountered  during  the  data  collection  process.  These 
problems  necessitated  changes  in  the  data  analysis  proce¬ 
dure  and  are  included  in  this  report,  as  they  are  per¬ 
tinent  to  the  results  and  conclusions  of  this  study.  This 
chapter  closes  with  a  summary  of  the  assumptions  and  limi¬ 
tations  associated  with  this  research. 

Definition  of  Populations 

This  research  was  initiated  with  the  intent  of 
conducting  a  statistical  analysis  to  study  the  relation¬ 
ship  suggested  by  the  first  Research  Proposition.  With 
that  goal  in  mind,  three  populations  were  identified  for 
study: 

1.  The  estimated  cost  of  AFLC  Type  1  training 
requirements  which  were  not  funded  in  FY79. 


2.  The  cost  to  APLC  of  continued  contractor  sup¬ 
port  when  used  as  an  alternative  to  Type  1  training  and  an 
organic  capability. 

3.  The  cost  to  AFLC  of  CETS  when  used  as  an 
alternative  to  Type  1  training  to  provide  informal  person¬ 
nel  training. 

For  the  statistical  analysis,  the  above  data  was 
to  be  divided  into  paired  samples  consisting  of  the  esti¬ 
mated  training  cost  of  unfunded  training  programs  (popula¬ 
tion  1)  and  the  respective  cost  of  the  alternative  imple¬ 
mented  by  AFLC  as  a  result  of  no  Type  1  training  (popula¬ 
tion  2  or  3) . 

The  selection  of  the  three  populations  was  based 
on  two  considerations: 

1.  The  use  of  FY79  data  was  made  with  the  assump¬ 
tions  that  planning  personnel  would  still  be  relatively 
familiar  with  FY79  problems  and  data  would  be  readily 
available;  and 

2.  Conclusions  drawn  upon  FY79  data  analysis  could 
be  extended  to  future  years.  That  is,  if  a  representative 
model  was  developed  it  could  be  applied  to  future  year 
fiscal  planning,  as  it  was  assumed  that  inflation  and 
advancements  in  technology  would  have  the  same  effects  on 
both  training  and  alternative  costs  such  that  the  model 
would  still  be  representative. 
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Definition  of  Variables 


The  independent  variable  for  this  research  was  the 
estimated  cost  of  the  Type  1  training  programs  required  by 
AFLC  in  FY79  which  were  not  funded. 

The  dependent  variables  were  the  cost  of  associated 
AFLC  alternatives,  continued  contractor  support  or  CETS, 
implemented  as  a  result  of  unfunded  training. 

Data  Collection  and  Analysis  Plan 
Data  collection  was  designed  as  a  sequential  pro¬ 
cess  starting  with  a  survey  of  all  training  requests  sub¬ 
mitted  by  AFLC  in  FY79  and  concluding  with  the  deter¬ 
mination  of  alternative  costs  for  associated  unfunded 
training  programs.  The  process  was  initially  proposed  to 
be  comprehensive  in  that  an  attempt  was  made  to  determine 
alternative  costs  for  all  unfunded  AFLC  Type  1  training 
programs.  This  attempt  was  later  found  to  be  futile  and  a 
change  in  research  strategy  was  necessitated,  as  will  be 
described  later  in  this  chapter. 

Data  collection  began  with  a  survey  of  all  Air 
Force  Form  403s  submitted  by  AFLC  which  identified  FY79 
special  training  requirements.  This  was  accomplished  by 
reviewing  all  403s  on  file  with  the  Programs  Division, 
DCS/Technical  Training  (HQ  ATC/TTPP) ,  Randolph  Air  Force 
Base  TX,  which  is  the  organization  responsible  for 


receiving  and  processing  all  403s  submitted  to  ATC  by  the 
major  commands  (24:11). 

Records  maintained  at  TTPP,  in  addition  to  the 
403s,  provided  information  on  the  action  taken  on  each  403 
by  the  STM,  including  type  of  training  required  to 
satisfy  the  training  request  (Figure  2) .  The  survey  con¬ 
sisted  of  noting  all  403s  which  were  identified  to  require 
Type  1  training  and  all  other  403s  which  were  not  iden¬ 
tified  for  a  particular  type  of  training  (Types  2,  4,  or 
5).  Therefore,  the  survey  produced  a  list  of  all  training 
requests  submitted  by  AFLC  which  were  identified  to 
require  Type  1  training  or  were  possible  candidates  for 
Type  1  training  in  FY79. 

The  next  step  in  the  data  collection  process  was 
to  determine  the  funding  status  of  each  program.  This  was 
initially  attempted  through  personal  and  telephone  inter¬ 
views  with  personnel  from  Systems  Training  Division,  HQ 
ATC/TTY ,  and  training  personnel  from  each  of  the  AFLC 
logistics  centers,  XX-ALC/DPCT.  The  interview  mode  of 
data  gathering,  however,  was  found  to  be  very  time  con¬ 
suming  and  not  always  productive.  Personnel  were  some¬ 
times  not  available  or  the  information  required  was  not 
immediatley  available  to  them,  necessitating  a  follow-up 
interview. 

As  a  result,  it  was  decided  that  a  letter 
request  to  each  of  the  Air  Logistics  Centers  (ALCs)  would 
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be  a  more  effective  means  of  gathering  the  research  data. 

A  letter  was  drafted  for  AFLC/DPC  signature  and  forwarded 
to  each  of  the  ALCs  with  an  attachment  listing  the  403s 
identified  against  each  respective  ALC  as  compiled  during 
the  ATC/TTPP  survey.  A  copy  of  the  letter  request  without 
attachments  is  provided  as  Appendix  A. 

In  accordance  with  the  letter,  each  ALC  was  tasked 
to  provide  the  following  information  for  each  403  listed 
in  the  letter  attachment  (five  different  attachments  were 
made,  each  listing  403s  for  the  respective  ALC) : 

1.  Identification  of  the  final  status  of  each  403 
based  on  the  following  definitions: 

a.  Deferred  (D) :  Type  1  was  no  longer 
required  in  FY79  due  to  changes  in  the  program  schedule  or 
program  requirements. 

b.  Funded  (F) :  Type  1  training  was  con¬ 
tracted  and  funded  by  ATC, 

c.  Unfunded  (UF) :  Type  1  training  was 
required;  however,  ATC  funding  was  not  available  to 
contract  for  the  training.  (For  this  research,  Type  1 
training  funded  by  AFLC  was  considered  unfunded,  as  AFLC 
funding  was  identified  as  an  alternative.) 

d.  Satisfied  (S) :  Training  requirement  was 
satisfied  by  Type  2,  3,  4,  and/or  5  training  arranged  by 


e.  Other  (0) :  Status  was  other  than  above; 
explanation  required. 

2.  For  each  403  identified  as  unfunded,  iden¬ 
tification  of  the  alternative  implemented  as  a  result  of 
no  training  funding  by  ATC.  The  following  alternatives 
were  provided;  however,  other  alternatives  could  be  used 
when  appropriate: 

a.  Continued  contractor  support  (CS) 

b.  In-house  training  (IH) 

c.  Contractor  Engineering  Technical  Services 

(CETS) 

d.  AFLC  obligation  authority  to  ATC  for 
contracting  (OA) 


(AT) 


e.  ALC  contract  (and  funding)  for  training 


3.  For  each  403  identified  as  unfunded,  iden¬ 
tification  of  the  cost  impact  of  the  alternative  imple¬ 
mented  and  the  estimated  training  cost  if  available. 

The  attachments  were  designed  such  that  ALC  per¬ 
sonnel  could  respond  on  the  attachments  using  the  codes 
listed  above  and  provide  cost  figures  when  required. 

It  was  anticipated,  after  subsequent  telephone 
contacts  with  each  of  the  five  ALCs,  that  this  method  of 
data  gathering  would  provide  sufficient  data  pairs  to  per 
mit  a  statistical  analysis  and  evaluation  of  the  research 
propositions.  As  stated  earlier  in  this  chapter,  however 
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the  attempt  to  gain  cost  impact  figures  on  the  alter¬ 
natives  implemented  was  found  to  be  futile  upon  receipt  of 
the  replies  from  the  ALCs  (Appendices  B  through  F) .  That 
is,  although  information  was  gained  from  the  replies,  cost 
data  were  not  provided  in  sufficient  quantity  to  enable  a 
statistical  analysis  or  derive  any  conclusions  as  to  the 
relationship  between  the  estimated  training  costs  and 
alternative  costs. 

At  this  point  in  time  it  was  necessary  to  step 
back  and  take  another  look  at  the  training  funding  problem 
and  the  strategy  for  this  research.  The  objective  remained 
valid;  however,  the  assumption  made  early  in  the  research 
that  FY79  data  would  be  readily  available  was  obviously 
not  a  valid  assumption.  It  was,  therefore,  proposed  to 
investigate  the  problems  or  issues  associated  with 
training  funding  at  the  ALC  and  Headquarters  levels,  and 
determine  why  more  data  were  not  obtained.  Also,  it  was 
decided  that  a  demonstration  of  the  proposed  statistical 
analysis  should  be  included  in  this  report  to  provida 
planning  personnel  with  a  working  example  of  the  statisti¬ 
cal  methodology  developed  to  investigate  the  research 
propositions.  This  demonstration  would  provide  AFLC 
training  personnel  and  ATC  System  Training  Managers  with 
a  description  of  the  statistical  methodology,  and  an 
application  of  the  methodology  to  hypothetical  data.  This 
methodology  could  then  be  applied  when  sufficient  data  were 
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accumulated  to  support  a  statistical  study.  The  methodo¬ 
logy  initially  proposed  for  this  research  is  provided  as 
Appendix  G  and  the  application  of  this  methodology  to 
hypothetical  representative  data  is  provided  as 
Appendix  H. 

As  a  first  step  to  investigating  the  training 
funding  problem,  a  detailed  summary  of  the  ALC  responses 
was  compiled  for  each  ALC  and  for  the  command.  Statistics 
were  computed  for  the  total  number  of  unfunded  training 
requests  and  the  total  number  of  these  which  included  a 
cost  impact.  The  unfunded  training  requests  were  further 
classified  by  the  alternatives  previously  identified  such 
that  each  unfunded  403  could  be  identified  against  one  of 
seven  categories: 

1.  Continued  contractor  support  (CS) 

2.  In-house  training  (IH) 

3.  Contractor  Engineering  Technical  Services 

(CETS) 

4.  AFLC  obligation  authority  (OA)  to  ATC 

5.  AFLC  training  funding  and  contract  (AT) 

6.  Personnel  received  training  but  method  not  spe¬ 
cified 

7.  No  alternative  given. 

The  results  of  the  above  analysis  and  general  conclusions 
drawn  from  the  statistics  are  provided  in  the  "Data 
Analysis"  section  of  Chapter  III. 


Additional  information  was  also  sought  concerning 
the  responses  by  again  going  to  the  telephones.  Each  ALC 
point-of-contact  (6;  7;  14;  19;  20)  was  asked  the  follow¬ 


ing  questions  to  provide  additional  background  on  the 
completion  of  the  responses: 

1.  Was  the  response  accomplished  independently  by 
DPCT  personnel  or  in  coordination  with  using  agencies? 

2.  Why  were  more  cost  impact  figures  not 
provided? 

3.  What  was  the  general  impact  of  no  Type  1 
training? 

The  responses  to  these  questions  are  provided  in  the 
"Findings"  section  of  Chapter  . III. 

Subsequent  to  the  above  interviews,  additional 
personal  interviews  were  conducted  with  Headquarters  AFLC 
personnel  to  discuss  the  results  of  the  ALC  survey  and  the 
training  funding  problem.  Question  2  above  was  posed  to 
headquarters  personnel  and  potential  barriers  to  obtaining 
cost  impact  figures  from  the  ALCs  were  discussed. 

Finally,  current  information  on  the  status  of  FY80  Type  1 
training  funding  was  discussed  and  related  to  the  objec¬ 
tives  and  findings  of  this  research.  The  results  of  these 
interviews  are  provided  in  the  "Findings"  section  of 
Chapter  III. 
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Research  Assumptions 


The  following  assumptions  apply  to  this  research: 

1.  It  was  initially  assumed  that  FY79  data  for 
Type  1  training  and  alternative  costs  would  be  readily 
available  to  support  a  statistical  analysis;  however,  this 
was  later  found  to  be  invalid. 

2.  It  was  assumed  that  AFLC  Type  1  training 
requirements  were  limited  to  those  from  the  five  Air 
Logistics  Centers.  Requirements  of  the  Aerospace  Guidance 
and  Metrology  Center  (AGMC) ,  Newark  Air  Force  Station, 
Ohio,  and  2750  Air  Base  Wing,  Wr ight-Patterson  Air  Force 
Base,  Ohio,  were  not  included  in  the  research.  This 
assumption  was  made  to  eliminate  any  unique  effects  which 
might  be  induced  in  the  relationship  investigation  by 
these  latter  two  organizations  when  compared  to  the  opera¬ 
tions  of  the  five  ALCs.  The  five  ALCs  were  assumed  to  be 
similar  in  function  and  operation  for  this  research. 

3.  If  a  relationship  and  model  could  be  developed 
from  past  data,  it  could  be  applied  to  and  be  represen¬ 
tative  of  future  years.  It  was  assumed  that  inflation  and 
advancements  in  technology  would  have  the  same  effects  on 
both  trainng  and  alternative  costs  such  that  the  rela¬ 
tionship  would  be  representative  in  future  years. 

4.  Any  assumptions  made  by  ATC  or  the  Air 
Logistics  Centers  in  determining  training  or  alternative 
costs  were  accepted  by  this  study. 
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Research  Limitations 

The  following  limitations  apply  to  this  research: 

1.  Findings  are  limited  to  application  to  Type  1 
training  requirements  of  AFLC  only. 

2.  Research  was  limited  to  information  made 


available  by  the  ALCs,  which  was  not  sufficient  to  draw 
any  conclusions  as  to  the  relationship  between  training 
costs  and  alternative  costs. 


CHAPTER  III 


DATA  ANALYSIS  AND  FINDINGS 

This  chapter  begins  with  a  summary  and  analysis  of 
the  responses  received  from  the  five  ALCs.  This  summary 
is  followed  by  a  discussion  of  the  results  of  the  tele¬ 
phone  interviews  conducted  with  ALC  training  personnel 
during  which  the  questions  presented  in  Chapter  II  were 
answered.  The  results  of  the  interviews  conducted  with 
Headquarters  AFLC  personnel  are  then  presented  and  related 
to  the  objective  of  this  research. 

Data  Analysis 

This  section  presents  a  summary  of  the  data 
gathered  from  the  ALCs  in  their  responses  to  the  letter 
request  provided  as  Appendix  A.  The  responses  for  the 
five  AFLC  Air  Logistics  Centers — Oklahoma  ALC  (OC-ALC) , 
Ogden  ALC  (OO-ALC) ,  San  Antonio  ALC  (SA-ALC) ,  Sacramento 
ALC  (SM-ALC) ,  and  Warner-Robins  ALC  (WR-ALC) — are  provided 
as  Appendixes  B  through  F  respectively. 

The  above  attachments  identified  a  total  of  three 
hundred  and  twenty-four  403s  which  were  classified  by  ATC 
to  require  Type  1  training  or  were  possible  candidates  for 
Type  1  training  in  FY79.  In  reviewing  the  data,  the  five 
ALCs  provided  virtually  complete  responses  to  the  extent 


that  the  funding  status  was  identified  for  all  but  two  of 
he  403s.  (A  follow-up  telephone  call  to  OO-ALC  was 
made  to  obtain  information  on  the  two  "unanswered"  403s; 
however,  additional  information  was  not  available.) 
Therefore,  it  was  possible  to  identify  the  403s  which  were 
unfunded  by  ATC  in  PY79.  The  identification  of  the 
alternatives  implemented  as  a  result  of  no  ATC  funding, 
however,  was  not  as  complete.  Only  56  percent  of  the  403s 
labelled  as  unfunded  had  any  alternative  indicated.  More 
importantly  for  this  study,  only  13  percent  of  the 
unfunded  403s,  or  24  percent  of  those  for  which  an  alter¬ 
native  was  listed,  included  a  cost  impact.  In  general, 
the  data  provided  in  the  "Alternative"  and  "Cost  Impact" 
columns  were  limited  and  insufficient  to  support  a  sta¬ 
tistical  analysis.  A  summary  of  the  responses  is  provided 
in  Tables  1  and  2. 

In  reviewing  the  "Alternative"  comments  in  the  ALC 
responses,  it  was  recognized  that  the  status  for  some  of 
the  individual  403s  was  not  consistent  with  the  defini¬ 
tions  provided  in  the  letter.  The  most  significant 
deviations  were  noted  in  the  WR-ALC  response  (Appendix  F) : 

1.  Thirteen  403s  were  listed  as  Other  (0)  with 
the  remark  "Not  funded  by  ATC  for  FY79,  resubmitted  for 
FY80."  These  403s  should  have  been  identified  as  Unfunded 
(UF) ,  with  information  provided  as  to  what  alternative  was 
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implemented,  and  at  what  cost  impact,  to  satisfy  the  depot 
requirement  in  FY79. 

2.  Twelve  other  403s  were  listed  as  unfunded  (UF) 
with  the  remark  "Delay  in  PMRT  no  FY79  impact."  Per  the 
definitions  in  the  letter,  these  403s  should  have  been 
listed  as  Deferred  (D) ,  since  the  requirements  were 
deferred  due  to  program  schedule  changes. 

Overall,  twenty-nine  responses  were  noted  to  be  in  error 
and  were  changed  by  the  authors  to  comply  with  the 
definitions,  based  on  the  remarks  provided  in  the 
"Alternative"  column.  The  results  of  these  changes  are 
provided  in  Table  3. 

The  total  number  of  403s  did  not  change,  however, 
as  a  result  of  these  corrections.  Ironically,  fourteen 
403s  were  changed  to  unfunded  status  and  fourteen  other 
403s  were  changed  from  unfunded  to  some  other  status. 

Only  one  of  the  twenty-nine  403s  marked  in  error  included 
a  cost  impact  remark.  Table  1  provides  corrected  and 
actual  numbers  of  403s  in  each  status. 

Before  continuing,  it  is  enlightening  and  appro¬ 
priate  at  this  point  to  reflect  upon  the  results  of  a 
training  workshop  convened  by  HQ  AFLC  in  May  79,  which 
included  representatives  from  each  of  the  ALCs  and 
appropriate  Headquarters  personnel.  The  purpose  of  the 
workshop  was  to  reconfirm  and  prioritize  FY79  Type  1 
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Table  3 

403s  AFFECTED  BY  STATUS  CHANGE 


Status 


Indicated 

Corrected 

Alternative 

ALC 

403 

by  ALC 

Status 

Remark 

00 

72S 

UF 

S 

Received  training  at 
Newark 

836 

UF 

D 

Slipped  to  FY81 

WR 

DO  8 

0 

D 

Not  funded  by  ATC — 

being  deferred  by 
supv.  til  later  date. 


Dll 
D20 
D22 
D23 
D24 
D25 

D34  0  UF 

D37 
D38 
D39 
D47 
D50 
D100 

L20  ,0  UF  ...  paid  by  DMIF 

R06 
R07 
R08 
R09 
R17 

R18  UF  D 

R33 
R34 
R35 
R36 
R38 
R54 


Delay  in  PMRT  no  FY79 
impact. 


Not  funded  by  ATC, 
resubmitted  as  FY80 
requirement. 


requirements  per  ATC  request  and  outline  procedures  for 
FY80  and  future  training  planning  and  funding.  Ironi¬ 
cally,  when  ALC  representatives  were  asked  to  defend 
training  requirements  and  provide  mission/cost  impacts, 
responses  very  similar  to  the  subject  responses  were 
provided.  In  many  cases,  the  impact  of  not  receiving 
Type  1  training  could  not  be  provided,  thus  raising  some 
question  as  to  the  validity  of  the  training  requirements 
(9)  . 


Findings 

This  section  presents  the  results  of  i-he  telephone 
interviews  conducted  with  the  ALC  Training  Branches  (DPCT) 
and  the  personal  interviews  conducted  with  Headquarters 
AFLC  personnel.  These  interviews  were  conducted  to  inves¬ 
tigate  the  problems  and  suspected  barriers  associated  with 
compiling  cost  impact  information.  Also,  updated  informa¬ 
tion  was  obtained  on  the  status  of  the  training  funding 
problem  in  FY80 ,  which  provided  additional  support  for  the 
objective  of  this  research. 

To  gain  additional  information  on  the  data  collec¬ 
tion  process  used  to  accomplish  the  ALC  responses,  each 
ALC  Training  Branch  (DPCT)  representative  (6;  7;  14;  19; 
20)  was  contacted  and  asked  the  questions  posed  in  Chap¬ 
ter  II.  A  summary  of  the  replies  to  these  questions  is 
provided  below. 


QUESTION  1:  Was  the  response  accomplished  inde¬ 
pendently  by  DPCT  personnel  or  in  coordination  with  using 
agencies? 

In  all  cases,  responses  were  completed  by  or  in 
coordination  with  using  agencies.  Therefore,  it  would 
seem  that  more  data  should  have  been  compiled  than  were 
provided  in  the  responses,  as  utilization  of  CETS  or  con¬ 
tinued  contractor  support  (as  a  result  of  no  ATC  training 
funding)  would  have  required  contracts,  with  documented 
contract  costs.  Also,  if  using  agencies  were  involved  in 
the  response  completion  process,  it  would  seem  that  infor¬ 
mation  should  have  been  available  on  alternatives  for  all 
403s  listed  as  unfunded.  The  question  which  comes  to  mind 
is: 

QUESTION  2:  Why  were  more  cost  impact  figures  not 
provided? 

Discussions  with  DPCT  personnel  and  the  letter 
responses  indicated  that  in-house  training  (IH)  is  fre¬ 
quently  the  alternative  implemented  in  reaction  to  no  ATC 
funding.  This  informal  training  is  typically  limited  to 
on-the-job  training  and  does  not  satisfy  the  training 
requirements  (6;  14;  19);  although,  an  organic  depot  capa¬ 
bility  is  achieved.  The  training  requires  on-duty  time, 
does  not  generally  provide  the  level  of  training  provided 
by  formal  Type  1  courses,  and  may  result  in  slower 
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response  time  by  the  depot.  The  cost  impact  of  these 
intangible  effects  is  obviously  difficult  to  ascertain 
since  they  are  part  of  day-to-day  operating  costs.  It  is 
interesting  to  note,  however,  that  in  two  interviews  (7; 
20)  it  was  indicated  that  in  many  cases  in-house  training 
satisfies  the  training  requirement,  and  subsequent  Type  1 
training  is  not  required.  If  this  is  the  case,  a  question 
arises  as  to  the  validity  of  the  original  Type  1  training 
requirement.  This  logic  may  be  extended  to  the  responses. 
If  some  training  requirements  are  submitted  on  a 
"nice-to-have"  basis  and  do  not  represent  a  valid  Type  1 
requirement,  then  the  lack  of  a  cost  impact  figure  seems 
logical.  This  issue  is  further  discussed  during  presen¬ 
tation  of  the  results  from  interviews  with  HQ  AFLC 
personnel. 

It  was  also  suggested  that  continued  contractor 
support,  CETS,  and  AFLC  training  funding  may  have  occurred 
more  frequently  than  indicated  in  the  responses.  These 
alternatives  do  not  involve  DPCT  coordination  and,  as  a 
result,  cost  impact  data  are  only  available  if  provided 
by  the  using  agencies.  Probable  reasons  why  using  agen¬ 
cies  may  not  have  included  these  data  in  their  responses 
are  also  provided  later  in  this  chapter  during  presen¬ 
tation  of  results  from  the  HQ  AFLC  interviews. 


36 


QUESTION  3.  What  is  the  general  impact  of  no 


Type  1  training? 

The  general  impact  of  no  formal  Type  1  training  as 
identified  by  the  interviews  was  slower  response  time  from 
the  ALC  and  operation  at  less  than  full  potential  with 
affected  equipment.  Frequently,  experience  on  new  equip¬ 
ment  is  gained  through  self-training  programs  conducted 
by  depot  personnel  to  a  level  at  which  the  required  tasks 
can  be  accomplished,  thereby  achieving  the  organic  depot 
capability.  This  in-house  training  typically  involves  on- 
the-job  training  gained  over  several  months  of  actually 
working  with  and  learning  from  the  equipment  and  related 
technical  orders,  and  does  not  generally  result  in  the 
level  of  expertise  provided  by  one  or  two  weeks  of  Type  1 
training.  Type  1  training  also  provides  training  on  all 
aspects  and  capabilities  for  which  the  equipment  was 
designed,  thus  ensuring  that  personnel  can  operate  equip¬ 
ment  at  its  full  potential.  This  result  is  not  always 
achieved  by  in-house  training.  Although  these  opera¬ 
tional  impacts  seem  to  be  logical  results  of  the  training 
funding  problem,  it  should  be  emphasized  that  this  infor¬ 
mation  is  strictly  based  on  the  telephone  interviews  and, 
therefore,  should  be  used  with  discretion  as  personal  per¬ 
ceptions  until  more  concrete  evidence  becomes  available. 


37 


Programs  supported  by  continued  contractor  support, 
CETS,  or  AFLC  training  funding  obviously  impose  additional 


costs  on  AFLC,  which  are  generally  unplanned  and  unbud¬ 
geted.  In  selected  cases,  Depot  Maintenance  Industrial 
Funds  (DMIF)  were  known  to  be  used  to  fund  training  (6; 

20) .  The  effects  of  these  costs  were  investigated  during 
interviews  with  HQ  AFLC  personnel,  the  results  of  which 
are  discussed  next. 

Following  the  telephone  interviews  with  ALC 
personnel,  personal  interviews  were  conducted  with  HQ  AFLC 
personnel  from  Employee  Development  and  Training  Division 
(DPCT)  (5;  27) ,  Financial  Management  Productivity  and 
Analysis  Division  (MAJA)  (21) ,  and  Resources  and  Manage¬ 
ment  Engineering  Division  (MASR)  (8).  These  interviews- 
were  less  structured  than  the  ALC  interviews,  since  the 
offices  contacted  did  not  possess  the  uniformity  in  func¬ 
tion  and  operation  common  to  the  five  ALC  Training 
Branches.  Questions  were  specific  to  the  office  being 
interviewed  and  differed  among  the  offices,  although 
Question  2  of  the  ALC  interviews  was  discussed  with  DPCT 
personnel. 

The  DPCT  interviews  provided  findings  on 
suspected  problems  in  the  data  collection  process  and 
current  information  on  the  status  of  FY80  training 
funding.  The  most  significant  finding  of  these  interviews 
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and  other  informal  interviews  conducted  during  this 
research  was  that  the  responses  were  considered  incomplete 
with  respect  to  the  identification  of  alternatives  imple¬ 
mented  and  associated  c-^st  impact.  It  is  suspected  that 
ALC  personnel  are  reluctant  to  discuss  past  alternatives 
as  funding  for  these  alternatives  may  not  always  be  con¬ 
sistent  with  operating  regulations.  For  example,  AFLC 
contracting  for  formal  training  is  not  authorized  without 
a  formal  waiver  to  AFR  50-9  (24:3);  however,  informal  con¬ 
versations  between  HQ  AFLC  personnel  and  ALC  personnel 
indicate  that  such  training  is  purchased.  Also,  funding 
for  this  training  is  suspected  to  come  from  sources  other 
than  those  authorized  for  formal  training  procurement. 

The  use  of  DMIF  funds  was,  until  March  1980,  not  offi¬ 
cially  authorized  for  training  procurement  (15); 
nevertheless,  interviews  indicate  that  these  funds  were 
used  in  FY79  to  purchase  training  by  the  ALCs  (6;  20). 

When  an  ALC  is  notified  by  ATC  that  funding  is  not 
available  for  a  requested  Type  1  training  requirement,  it 
must  seek  some  other  alternative  to  satisfy  at  least  the 
current  year's  depot  support  responsibility.  If  CETS, 
continued  contractor  support,  or  AFLC  funded  training  is 
selected  as  the  alternative,  the  additional  costs  must  be 
satisfied  by  available  funds.  It  appears  in  satisfying 
this  requirement  the  ALCs  must  at  times  provide  justifica¬ 
tion  for  alternatives  or  utilize  funding  which  is  not 
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consistent  with  published  directives.  As  a  result,  it  is 
suspected  by  AFLC/DPCT  personnel  that  ALC  personnel  are 
reluctant  to  provide  documented  information  on  these  past 
actions . 

Another  problem  arises  in  that  there  does  not 
appear  to  be  a  requirement  to  monitor  costs  on  alterna¬ 
tives  implemented.  As  a  result,  the  annual  costs  asso¬ 
ciated  with  implementing  an  alternative  such  as  CETS  or 
continued  contractor  support  are  "buried  in  the  files,"  and 
not  easily  identified,  especially  if  ALC  personnel  question 
"what  is  to  be  gained"  from  going  to  the  effort  of 
researching  the  costs.  Without  these  alternative  costs, 
the  investigation  of  the  Research  Propositions  is  effec¬ 
tively  not  possible. 

In  reference  to  FY80  training  funding,  correspond¬ 
ence  (26)  and  a  DPCT  interview  (27)  indicated  that  ATC 
requested  24.4  million  dollars  for  FY80  Type  1  training 
but  received  only  9.8  million  dollars.  In  response  to  ATC 
requests,  AFLC  prioritized  its  203  outstanding  403s  which 
required  Type  1  training  in  FY80.  A  priority  listing  of 
the  top  one  hundred  and  three  403s  was  submitted  to  ATC 
for  initial  funding  consideration.  ATC  in  turn  advised 
AFLC  that  under  current  funding  constraints,  only  the  top 
fifty  AFLC  Type  1  requests  could  be  funded. 

In  an  effort  to  ensure  that  mission-essential 
Type  1  training  requirements  are  funded,  AFLC/DCS 
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Maintenance  (AFLC/MA)  issued  instructions  for  all  AFLC 
installations  regarding  the  use  of  DMIP  funds  for  procure¬ 
ment  of  training.  The  following  policy  was  defined  by 
AFLC/MA  and  provided  to  each  XX-ALC/DPCT  office: 

a.  An  attempt  should  be  made  to  have  ATC  fund  all 
such  training.  When  ATC  funds  are  not  available,  an 
attempt  will  be  made  where  lead  time  permits  to  fur¬ 
nish  ATC  with  a  fund  cite.  In  the  event  lead  time  is 
not  available,  an  exception  to  AFR  50-9  will  be  sub¬ 
mitted  by  message  to  AFLC/DPCT  requesting  authority  to 
procure  locally  the  vendor  training. 

b.  In  the  event  ATC  fails  to  fund  a  critical 
maintenance  Type  1  training  requirement,  DMIF  funds 
may  be  used  for  that  purpose. 

c.  Approval  to  expend  these  funds  will  be  at  the 
directorate  level. 

d.  The  expenditure  of  DMIF  funds  for  training 
will  be  limited  to  DMIF  employees  [15]. 

In  providing  the  guidance  policy,  it  appears  that 
AFLC  is  only  providing  formal  authorization  to  a  funding 
alternative  that  was  already  being  used  by  the  ALCs,  as 
previously  discussed.  In  any  event,  the  policy  does  not 
appear  to  represent  a  solution  but  only  a  means  of  coping 
with  the  training  funding  problem;  although,  AFLC  person¬ 
nel  believe  it  should  relieve  some  of  the  pressure  imposed 
on  the  ALCs  and  reduce  the  requirement  for  potentially 
more  expensive  CETS  or  continued  contractor  support. 

The  use  of  DMIF  funds,  however,  may  generate  long¬ 
term  problems.  Interviews  with  AFLC/MA  personnel  (9;  21) 
provided  some  insight  into  the  potential  impact  of 
training  funding  on  AFLC  operations.  The  DMIF  is  used  by 
AFLC  to  fund  maintenance  operations  at  the  ALCs,  including 


the  cost  of  labor,  materials,  and  overhead.  It  is  reim¬ 
bursed  from  the  using  commands  through  the  sales  rates 
charged  by  AFLC  for  depot  actions  accomplished.  These 
sales  rates  are  established  by  AFLC  two  years  in  advance 
and  approved  at  the  Office  of  Secretary  of  Defense  (OSD) 
level.  Therefore,  any  additional  costs  incurred  by  the 
DMIF  in  FY80  such  as  funding  for  Type  1  training,  can  only 
be  recovered  through  increased  sales  rates  established 
for  FY83  depot  maintenance  (unless  OSD  approval  is 
received  for  increases  in  earlier  year  sales  rates) . 
Approval  for  use  of  DMIF  funds  was  made  locally  by 
headquarters  personnel  based  on  their  interpretation  of 
DMIF  directives  (21) .  The  future  impact  of  DMIF  training 
funding  on  sales  rates,  and  possibly  even  the  legality  of 
the  use  of  DMIF  funds  for  training  funding  when  reviewed 
by  Air  Staff  or  Congressional  committees,  remains 
questionable. 

Another  action  taken  by  AFLC  to  cope  with  the 
training  funding  problem  concerns  the  approval  of  ALC  403s 
at  headquarters  level  as  a  prerequisite  to  submission  to 
ATC  (27).  As  stated  in  Chapter  I,  all  training  require¬ 
ments  for  the  ALCs  are  now  submitted  to  ATC  through  HQ 
AFLC  effective  with  FY80  training  requests.  This  addi¬ 
tional  coordination  level  is  intended  to  ensure  that  only 
valid  training  requirements  are  submitted  to  ATC,  thereby 
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minimizing  the  number  of  previously  mentioned  "nice-to- 
have"  requests  for  training,  and  enable  headquarters 
personnel  to  more  effectively  prioritize  command  training 
requirements.  To  support  this  headquarters  level  review 
process,  ALCs  will  be  tasked  to  provide  a  detailed  impact 
statement  with  each  403  submitted.  This  requirement 
further  supports  the  objective  of  this  research,  as 
meaningful  cost  impact  information  will  be  required 
earlier  in  the  planning  process.  In  contrast  to  devel¬ 
oping  cost/mission  impact  statements  in  reaction  to 
requests  from  ATC,  the  ALCs  will  now  have  to  predict 
impacts  as  part  of  the  403  processing.  If  a  represen¬ 
tative  model  which  could  be  used  to  predict  alternative 
costs  from  the  estimated  training  costs  can  be  developed, 
it  could  be  utilized  to  support  this  earlier  requirement 
for  cost  impact  estimates. 

Chapter  IV  presents  the  conclusions  drawn  from 
these  Findings  and  provides  recommendations  for  improve¬ 
ment  in  fiscal  control  in  the  area  of  training  funding. 
Also,  recommendations  for  further  research  are  provided 
based  on  questions  identified  during  this  research. 


CHAPTER  IV 


CONCLUSIONS  AND  RECOMMENDATIONS 
Summary 

This  research  effort  was  initiated  to  investigate 
the  cost  impact  on  AFLC  as  a  result  of  a  shortage  in 
Type  1  training  funds  available  to  ATC.  Two  research  pro¬ 
positions  were  identified  for  the  study.  The  first  propo¬ 
sition  suggested  the  existence  of  a  positive  linear  rela¬ 
tionship  between  the  estimated  cost  of  unfunded  AFLC  Type 
1  training  and  the  cost  to  AFLC  of  implementing  alter¬ 
natives  (specifically,  CETS  or  continued  contractor  sup¬ 
port)  .  The  second  proposition  involved  the  cost  effec¬ 
tiveness  of  these  AFLC  implemented  alternatives  and  sug¬ 
gested  that  it  would  be  more  cost  effective  for  the  Air 
Force  to  provide  additional  ATC  funding  for  Type  1  train¬ 
ing  then  to  have  AFLC  implement  alternatives.  To  test 
these  propositions,  a  statistical  methodology  was  devel¬ 
oped  around  the  basic  linear  regression  model.  Data  were 
then  gathered  on  total  FY79  AFLC  Type  1  training  require¬ 
ments  and  an  attempt  was  made  to  compile  data  on  training 
costs  and  alternative  costs  for  those  Type  1  training 
requirements  which  could  not  be  funded  by  ATC.  Problems 
encountered  during  the  data  collection  process  altered  the 


research  approach  and  resulted  in  an  investigation  of  the 
reasons  why  these  problems  may  have  occurred.  Since  the 
data  collected  was  not  sufficient  to  support  the  proposed 
statistical  tests,  a  demonstration  of  the  procedures  was 
conducted  and  included  in  this  report  to  provide  a  guide¬ 
line  for  further  research  on  the  previously  described 
propositions.  Also,  information  on  the  FY80  Type  1 
training  funding  situation  was  gained  from  interviews  with 
HQ  AFLC  personnel.  This  information  provided  additional 
support  for  continuation  of  this  research. 

The  next  section  of  this  chapter  presents  the 
conclusions  of  this  research  effort.  The  final  section 
presents  recommendations  to  AFLC  for  improved  fiscal 
control  and  suggests  areas  for  further  research. 

Conclusions 

The  results  of  this  research  are  heavily  dependent 
upon  the  responses  received  during  personal  and  telephone 
interviews  and,  hence,  may  include  both  fact  and  personal 
bias  concerning  the  questions  and  issues  studied.  The 
results  of  both  the  ALC  written  responses  and  interviews, 
however,  do  provide  strong  circumstantial  evidence  to 
suggest  that  the  cost  impact  of  implementing  alternatives 
is  a  very  sensitive  area  at  the  ALC  level.  It  appears 
that  ALC  functional  managers  are  faced  with  a  dilemma  when 
requested  Type  1  training  cannot  be  funded  by  ATC.  If  the 


training  is  required  to  support  a  valid  depot  requirement 
(in  contrast  to  "nice-to-have"  training) ,  then  the  func¬ 
tional  manager  must  seek  some  other  alternative  to  satisfy 
at  least  the  current  year's  depot  responsibility.  If  that 
alternative  is  other  than  an  in-house  training  program 
(that  is,  CETS,  continued  contractor  support,  or  ALC 
funded  training) ,  then  it  seems  reasonable  to  conclude 
that  the  funds  used  to  implement  that  alternative  are 
unplanned  and  unbudgeted,  and  must  come  from  available 
operating  funds.  The  results  suggest  that  in  some  cases 
funds  expended  are  not  in  accordance  with  published 
directives.  (This  conclusion  could  not  be  supported  by 
documented  evidence;  however,  the  response  was  frequently 
received,  especially  during  informal  communications.)  The 
end  result,  the  depot  may  satisfy  its  immediate  require¬ 
ment  without  the  aid  of  Type  1  training. 

If  the  above  scenario  is  accurate,  then  it  may 
also  explain  the  difficulty  in  obtaining  cost  impact  data 
from  the  ALCs.  If  funding  was  not  in  accordance  with 
directives  (for  example,  ALC  contracts  for  Type  1  training 
without  a  waiver  to  APR  50-9) ,  then  there  would  be  a 
potential  reluctance  on  the  part  of  the  functional  mana¬ 
gers  to  provide  alternative  cost  data,  or  even  identify 
the  alternative  implemented. 


46 


Considering  the  in-house  training  alternative,  the 
ALC  responses  indicated  this  alternative  to  be  the  most 
frequently  used;  however,  there  was  some  contradiction  in 
the  results  as  to  the  impact  of  its  use.  Training  repre¬ 
sentatives  from  three  ALCs  indicated  that  in-house 
training  is  a  "make  do"  effort  and  does  not  fully  qualify 
depot  personnel  or  eliminate  the  need  for  Type  1  training. 
Representatives  from  the  remaining  two  ALCs  stated  that 
in-house  training  frequently  satisfies  the  training 
requirement  and  future  Type  1  training  is  no  longer 
required.  For  this  case,  an  unanswered  question  arises  as 
to  the  validity  of  the  original  Type  1  training  request  if 
in-house  training  satisfies  the  need.  The  results  were 
inconclusive  as  to  the  effectiveness  of  this  alternative. 

The  Headquarters  AF-LC  proposed  program  to  require 
impact  statements  with  all  ALC  Type  1  training  requests 
(403s)  should  help  to  increase  the  awareness  of  personnel 
at  both  levels  in  the  command  on  the  impacts  of  unfunded 
training.  To  date,  impact  statements  have  been  compiled 
seemingly  only  in  response  to  ATC  requests.  Today's 
increased  public  concern  for  defense  expenditures  necessi¬ 
tates  that  funds  be  expended  in  the  most  efficient  manner. 
This  program  should  contribute  to  ensuring  that  only  valid 
training  is  requested  from  ATC,  and  provide  both  AFLC  and 
ATC  personnel  with  mission/cost  impact  information  which 
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can  be  used  in  assessing  program  priority  under  limited 
funding  conditions. 


Recommendations 

It  is  recommended  that  HQ  AFLC  require  that  the 
ALCs  track  and  maintain  cost  impact  data  on  all  programs 
for  which  CETS  or  continued  contractor  support  is  imple¬ 
mented  as  a  result  of  a  negative  funding  response  from  ATC 
(for  requested  Type  1  training) .  These  figures  would  pro¬ 
vide  a  data  base  to  support  investigation  of  the  research 
propositions  and  could  be  used  to  support  requests  for 
additional  Type  1  training  funding  submitted  to  Air  Staff. 
In  contrast  to  past  funding  requests  which  frequently  used 
estimated  cost  impact  figures,  future  requests  could  pro¬ 
vide  documented  cost  information  which  reflects  the  actual 
impact  of  unfunded  Type  1  training.  Also,  the  data  could 
be  used  internally  by  the  ALCs  and  HQ  AFLC  to  aid  in 
determining  the  most  cost  effective  alternative  to  imple¬ 
ment  in  response  to  future  funding  shortages.  For 
example,  data  may  indicate  that  it  is  more  cost  effective 
for  the  ALC  to  provide  obligation  authority  to  ATC  to 
contract  for  the  necessary  Type  1  training  than  to  imple¬ 
ment  CETS  or  continued  contractor  support. 

In  considering  cost  impact,  an  attempt  should  be 
made  to  assess  not  only  the  immediate  impact  of  imple¬ 
menting  the  alternative,  that  is  the  contract  cost  for 
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CETS  or  continued  contractor  support,  but  also  the 
indirect  impacts.  For  example,  if  unplanned  CETS  must  be 
implemented,  what  other  operations  or  functions  in  the 
depot  are  affected  by  the  diversion  of  funds  to  procure 
CETS,  and  what  is  the  cost  impact  on  these  areas? 

Although  these  costs  are  less  tangible  than  the  contract 
costs,  an  assessment  of  these  costs  would  provide  a  more 
comprehensive  picture  of  the  total  cost  impact  of  imple¬ 
menting  the  alternative.  This  approach  would  be  applic¬ 
able  to  all  the  alternatives  initially  posed  in  Chapter  I, 
and  may  be  especially  appropriate  in  providing  some 
measure  of  the  impact  of  implementing  an  in-house  training 
program.  To  date,  it  does  not  appear  that  the  impact  of 
in-house  training  is  really  known,  except  to  say  that  it 
seems  to  slow  depot  response  time,  since  personnel  are 
less  skilled  than  when  provided  Type  1  training.  Also, 
these  lower  skill  levels  may  preclude  personnel  from 
operating  equipment  at  its  full  potential,  therefore,  the 
Air  Force  does  not  receive  full  return  on  its  investment. 
Quantifying  these  effects  would  provide  better  information 
to  ATC  and  AFLC  training  personnel  with  which  to  more 
accurately  assess  the  impact  if  a  particular  training 
program  is  not  funded,  and  provide  a  measure  against  which 
other  programs  of  a  similar  need  could  be  compared. 


.1  I  apaipp 


It  is  recommended  that  research  be  continued  on 
the  validity  of  the  research  propositions  described 
herein.  Also,  the  following  questions  are  suggested  for 
further  study: 

1.  Is  the  use  of  DMIF  funds  for  Type  1  training 
procurement  consistent  with  published  directives  and 
Congressional  guidelines? 

2.  What  will  be  the  long-term  impact  of  the  use 
of  DMIF  funds  to  support  ATC  unfunded  Type  1  training? 
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APPENDIX  A 


AFLC/DPC  LETTER 


DEPARTMENT  OF  THE  AIR  FORCE 

HEADQUARTERS  AIR  FORCE  LOGISTICS  COMMAND 
WRIGHT-PATTERSON  AIR  FORCE  BASE.  OHIO  45433 

REPLY  TO  .  f 

ATTN  OF,  D  PC 

.U.J.CT,  Fiscal  Year  1979  AF  Form  403  Information 


TO'  OC-ALC  SM-ALC 

00-ALC  WR-ALC 

SA-ALC 

(Civilian  Personnel  Officer) 

1.  Request  you  provide  this  office  with  final  status  informa¬ 
tion  on  FY  80  Type  I  training  identified  in  Attachment  1  by 

15  February  1980. 

2.  This  information  is  needed  to  accomplish  an  AFIT  study 

to  investigate  the  cost  impact  on  AFLC  of  unfunded  Type  1  train¬ 
ing.  To  support  this  study,  information  is  required  on  the 
status  of  AF  Form  403s  submitted  by  your  installation  for  FY  79 
training  and  identified  by  ATC  as  Type  1  training.  The  objec¬ 
tive  of  this  study  is  to  relate  the  estimated  cost  of  unfunded 
Type  1  training  to  the  cost  of  implementing  alternatives  or 
workaround  procedures  as  a  result  of  insufficient  ATC  training 
funds.  In  order  to  reduce  the  work  load  and  impact  of  this 
request,  all  403s  submitted  to  HQ  ATC/TTPP  by  your  installation 
for  FY  79  training  were  screened  to  identify  those  potentially 
requiring  Type  1  training.  The  403s  identified  for  Type  2, 

3.  4,  and/or  5  training  by  ATC  were  excluded  from  the  study. 

The  403s  which  were  identified  for  Type  1  training  or  were 
not  identified  against  a  specific  type  of  training  comprise 
the  list  in  Attachment  1. 

4.  Request  that  your  response  provide  the  following  informa¬ 
tion  for  each  403  listed  (in  addition,  please  include  any  addi¬ 
tional  403s  which  would  enhance  the  study). 

a.  Status.  Identify  the  final  status  of  each  403  based 
on  the  following  definitions: 

(1)  Deferred  (D):  Program  schedule  changed  such  that 
training  was  no  longer  required  in  FY  79. 

(2)  Funded  (F):  Type  1  training  was  conducted  and 
funded  by  ATC. 

(3)  Unfunded  (UF):  Type  1  training  was  required; 
however,  ATC  funding  was  not  available  to  contracting  for  train¬ 
ing  (Type  1  training  funded  by  AFLC  is  considered  unfunded 

for  this  study) . 
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(4)  Satisfied  (S):  Training  requirement  was  satisfied 
by  types  2,  3,  4  and/or  5  training  arranged  by  ATC. 

(5)  Other  (0):  Specify  status  if  above  not  applicable. 

b.  If  training  was  unfunded,  identify  the  alternative 
measures  implemented  as  the  result  of  no  training  funding  by 
ATC;  that  is,  continued  contractor's  support  (CS),  in-house 
training  (IH),  Contact  Technical  Services  (CETS),  obligation 
authority  to  ATC  for  contracting  (OA),  ALC  contract  for  train¬ 
ing  (AT),  or  other  alternatives  as  applicable. 

c.  Provide  a  cost  impact  using  actual  costs  if  applicable 
due  to  implementing  the  above  alternatives  for  each  403  identi¬ 
fied  as  unfunded,  and  the  estimated  Type  1  training  cost  if 
known. 

5.  We  sincerely  regret  the  additional  work  load  imposed  by 
this  request;  however,  the  problems  associated  with  Type  1 
training  funding  levels  have  plagued  all  of  us  for  some  time. 
Throughout  FY  79,  we  have  taken  many  actions  to  improve  the 
funding  levels  and  AFLC/CC  has  signed  several  letters  to  USAF/CSAF 
and  ATC/CC  expressing  concern  and  requesting  assistance.  Based 

on  the  severity  of  the  problem  and  the  level  of  concern,  request 
your  assistance  in  providing  this  information  which  may  prove 
beneficial  in  obtaining  additional  Type  1  training  funds. 

6.  The  AFLC/DPCT  contact  is  Russ  Henss,  AUT0V0N  787-7483, 
and  the  AFIT/LS  contact  is  Capt  Carl  Wiles  or  Lt  John  Allen, 
AUT0V0N  785-4437. 

FOR  THE  COMMANDER 


EARL  A,  ALER 

Directorate  o?  Civilian  Personnel 
Or'ico  or  OCS/r  :r;cnnel 


1  Atch 

AF  Form  403  Listing 


OC-ALC  RESPONSE 


C-ALC  (Conti 


$250 


(Cont) 


(Cont) 


OO-ALC  RESPONSE 


Received  training  at  Newark 


Ogden  (Cont) 


In  house 


n  (C'unL) 


03  padd 


n  (Cont) 
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San  Antonio  (Cont) 


526 


San  Antonio  (Cont) 


560 


M/TIQ  11  X  Not  Accomplished  In  FY79 


^funded  by  ATC,  resubmitted 
as  FY  80  requirement 


R-ALC  (Cont) 


AD-A087  007  AIR  FORCE  INST  OF  TECH  MRIGHT-PATTERSON  AFB  OH  SCHOOL— ETC  F/G  14/1 

COST  IMPACT  INVESTIGATION  OF  AFLC  UNFUNDED  TYPE  I  (CONTRACTOR)  — ETC(U) 
JUN  80  J  N  ALLEN*  C  J  MILES 

UNCLASSIFIED  aFIT-LSSR  13-80  NL 


R-ALC  (Con t) 


R68  I  I  X  I  No  requIrements-Cancel 


(Cont) 


(Cont) 


CHECK  STATUS  ESTIMATED 


CHECK  STATUS 


APPENDIX  G 


STATISTICAL  MODEL  SELECTION 
AND  ADAPTATION 


This  Appendix  presents  the  statistical  methodology 
that  was  to  be  used  in  this  research;  that  is,  before  it 
was  concluded  that  the  data  received  were  inappropriate  for 


the  statistical  application.  The  purpose  of  presenting 
the  methodology  in  this  report  is  to  provide  an  explana¬ 
tion  of  the  statistical  analysis,  which  may  be  used  in 
future  research  if  sufficient  data  are  obtained.  In  the 
remainder  of  this  Appendix,  it  will  be  assumed  that  the 
necessary  data  have  been  collected.  It  will  thus  be  easier 
to  follow  the  development  of  the  methodology  by  anyone  who 
actually  has  the  data. 

To  enhance  the  understanding  of  this  procedure  a 
demonstration  using  fictitious  data  points  is  provided  in 
Appendix  H.  This  demonstration  includes  an  analysis  of 
the  statistical  results  and  representative  conclusions. 

Model  Selection  and  Adaptation 

After  completion  of  the  data  collection  process, 
investigation  of  the  proposed  relationship  may  begin. 

There  are  two  categories  of  relationships  between  depen¬ 
dent  and  independent  variables:  functional  relations  and 
statistical  relations.  In  a  functional  relation,  the 
value  of  the  dependent  variable  is  uniquely  determined 
when  the  value  of  the  independent  variable  is  specified. 

In  a  statistical  relation,  however,  the  value  of  the 
dependent  variable  is  not  uniquely  determined  by  the  value 


of  the  independent  variable.  Rather,  the  value  of  the 
independent  variable  associates  a  probability  distribution 
with  a  range  of  values  for  the  dependent  variable 
(10:435-436) . 

The  estimated  cost  (X)  of  an  unfunded  training  pro¬ 
gram  does  not  uniquely  determine  the  cost  (Y)  to  AFLC  of 
implementing  a  particular  alternative  (population  2  or  3); 
however,  X  may  be  used  to  determine  the  expected  value  of 
Y,  E(Y).  Therefore,  the  appropriate  relation  to  be  estab¬ 
lished  for  each  alternative  is  a  statistical  one.  A  sim¬ 
ple  linear  regression  model  is  used  to  determine  each  sta¬ 
tistical  relation.  The  explanation  which  follows  applies 
to  both  relationships.  That  is,  the  statistical  proce¬ 
dures  are  applied  to  both  alternatives  in  the  same  manner. 
The  narrative  is  simplified  by  discussing  a  single  statis¬ 
tical  relation,  hereafter  referred  to  as  relation,  between 
X  and  Y. 

There  are  several  advantages  to  using  the  regres¬ 
sion  function  of  the  simple  linear  regression  model.  One 
advantage  is  ease  of  interpretation.  The  model  has  a 
simple  linear  equation  form,  EQ.l;  thus,  it  can  be  easily 
applied  by  planning  personnel. 

E (Y)  -  60  +  BjX  EQ.l 

where  BQ  and  are  regression  parameters  (10:440). 

Another  advantage  is  the  availability  of  information  on 


developing  and  making  inferences  about  the  model.  Finally, 
several  computer  programs  have  been  written  to  adapt  the 
linear  regression  model  to  a  given  set  of  data. 

The  program  used  in  this  research  is  the  Regres¬ 
sion  procedure  contained  in  the  Statistical  Package  for 
the  Social  Sciences  (SPSS)  (11:342),  which  is  available  on 
AFLC's  CREATE  computer  system.  The  SPSS  input  file  and 
selected  output  for  the  Regression  procedure  are  provided 
in  Appendices  H-3  and  H-4,  respectively.  The  SPSS  output 
contains  the  estimated  values  for  and  6^,  bQ  and 
b^  respectively,  which  best  fit  the  model  to  the  data. 

The  regression  function  (EQ.l)  can  be  estimated  by  substi¬ 
tuting  these  values  into  EQ.2,  the  estimated  regression 
function,  which  provides  a  point  estimate  (Y)  for  the 
expected  value  of  Y  (10:446). 

Y  -  bQ  +  bxX  EQ.2 

The  output  also  contains  other  information,  which  will  be 
interpreted  as  needed. 

Tests  for  Aptness 

An  important  point  to  ponder  is  the  aptness  of  the 
linear  regression  model  to  the  relevant  data.  Aptness  is 
validated  or  invalidated  by  investigating  the  four  assump¬ 
tions  of  the  linear  regression  model:  linearity,  con¬ 
stancy  of  variance,  independence  of  the  residuals,  and 
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normality  of  the  residuals  (10:439).  A  residual,  e^,  is 
the  difference  between  the  observed  value  of  Y^,  obtained 
from  input  data,  and  Y^,  from  EQ.2. 

ei  *  Yi  -  Y.  i=l , 2 ,3, . . .  ,N  EQ.3 

where  N  is  the  number  of  input  data  pairs  (X^  Yi) 

(10:448).  The  calculated  residuals  are  used  in  the  aptness 
investigation  by  means  of  residual  analysis. 

The  assumptions  of  linearity,  constancy  of 
variance,  and  normality  are  testable  in  this  research. 

The  assumption  of  independence  of  residuals  is  not  tested 
in  the  aptness  of  the  model  since  the  required  time  asso¬ 
ciation  between  variables  is  not  present.  Considering 
that  the  estimated  cost  of  training  and  the  cost  of  alter¬ 
natives  are  obtained  from  several  agencies  within  ATC  and 
AFLC  respectively,  each  agency  providing  cost  data  for 
programs  for  which  it  is  responsible,  the  assumption  of 
independence  seems  reasonable. 

Residual  Scattergram.  Linearity  is  validated  by 
observing  a  residual  scattergram.  If  the  true  regression 
function  is  linear,  the  residuals  should  scatter  at  random 
around  the  value  zero.  Any  scatter  pattern  other  than 
random  indicates  nonlinearity  of  the  true  regression 
function;  therefore,  nonrandoraness  of  the  residual  scat¬ 
tergram  would  invalidate  the  simple  linear  regression 
model  (10:482).  If  this  occurs,  another  model  would  have 
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to  be  considered  by  investigating  alternative  relation¬ 
ships,  such  as  the  exponential  or  quadratic. 

Another  use  of  the  residual  scattergram  is  to 
verify  that  the  residual  variance  is  constant.  Non¬ 
constant  variance  is  displayed  on  the  scattergram  as  a 
scatter  plot  with  an  increasing  or  decreasing  trend  in 
residual  magnitude  (see  Figure  6).  Nonconstant  residual 
variance,  as  nonrandomness,  would  invalidate  the  linear 
regression  model  (10:482). 


Fig.  6.  Scatter  Diagrams  Showing  Constant 
and  Nonconstant  Variance 

K-S  Test.  Normality  of  the  residuals  is  tested 
using  the  Kolmogorov-Smirnov  (K-S)  test  (10:403).  A  spe¬ 
cial  test  statistic  is  used  with  the  K-S  test  which 
provides  more  flexibility  in  the  number  of  observations 
required  for  valid  results:  the  Lilliefores  test  sta¬ 
tistic  (3:398).  Normality  of  the  residuals  is  required  to 
validate  the  linear  regression  model. 
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Inferences  on  the  Model 

Once  the  model  is  shown  to  be  apt,  the  next  step  is 

to  make  inferences  on  the  model.  It  is  important  at  the 

outset  to  determine  the  extent  of  relationship  between  the 

independent  and  dependent  variables.  A  judgmental  decision 

on  this  relationship  can  be  made  by  examining  the  scatter- 

gram  given  in  the  SPSS  output  (Appendix  H-4) .  In  effect, 

it  can  be  determined  by  observation  if  X  and  Y  are  closely 

related  (approaching  a  functional  relationship)  or  if  they 

are  hardly  related  at  all.  To  aid  in  this  determination, 

a  numerical  measure  of  this  extent  of  relationship  is 

available  in  the  SPSS  output  (Appendix  H-4) .  This  numerical 

measure  is  called  the  coefficient  of  determination,  denoted 
2 

as  r  .  This  coefficient  is  used  to  express  the  degree  of 

statistical  relationship  between  the  independent  variable  X 

2 

and  the  dependent  variable  Y.  The  value  of  r  varies  from 
zero  to  one.  A  value  of  zero  implies  that  there  is  no  rela¬ 
tionship  between  X  and  Y;  that  is,  X  is  of  no  help  in  pre¬ 
dicting  Y.  On  the  other  hand,  a  value  of  one  implies  a 
definite  relationship  between  X  and  Y;  that  is,  perfect  pre¬ 
dictions  of  Y  can  be  made  from  X  (10:458).  Figure  7 

2 

illustrates  these  two  extremes.  Obviously,  an  r  equal  to 

one  is  optimum;  however,  it  is  not  generally  obtainable  in 

2 

practice.  For  this  analysis,  a  value  of  r  of  0.80  or 
above  is  desired,  as  it  will  indicate  a  relatively  high 
degree  of  linear  statistical  relation  between  the 
estimated  training  costs  and  associated  alternative  costs. 


93 


Fig.  7.  Scatter  Diagrams  For  r  =»  1  and  r  ■  0 


The  coefficient  of  determination  can  be  found  in  the  SPSS 
output  under  the  heading  of  "R  SQUARE"  (Appendix  H-4,  page 
119)  . 

As  illustrated  in  Figure  8,  there  are  four 
possible  outcomes  for  the  regression  function  based  upon 
four  possible  combinations  of  SQ  and  0^ 


1. 

eo 

> 

0 

and 

H 

CQ 

> 

1 

2. 

eo 

< 

0 

and 

81 

1 

3. 

o 

CQ 

> 

0 

and 

81 

< 

1 

4. 

o 

CQ 

< 

0 

and 

81 

< 

1 

It  should  be  pointed  out  that  the  possibility 
a  peculiarity  of  the  model  and  does  not  imply 
costs.  The  "equal  to"  alternatives  (g0  * 


of  6  0  <  0  is 
negative 
■  1) 


0  and  0, 


NOTE: 


Estimated  Training  Cost  (X) 

Solid  lines  indicate  region 
where  alternative  cost  >  esti 
mated  training  cost. 

Dashed  lines  indicate  region 
where  alternative  cost  <  esti 
mated  training  cost 


Fig.  8.  Four  Possible  Outcomes  for  the  Regression 
Function,  E(Y)  =  Bq  +  S^X 


«  .rt  +>  r 


are  not  considered  as  possible  outcomes  since  the  proba¬ 
bility  o£  a  continuous  random  variable  having  a  unique 
value  on  the  continuum  is  zero  (10:107).  In  other  words, 
P(6q  *  0)  *  P(  8^  *  1)  =0.  The  significance  of  the  com¬ 
parison  values  for  Sg  and  (zero  and  one,  respectively) 
are  discussed  next. 

One  of  the  above  four  outcomes  describes  the  final 
regression  function  and  provides  information  on  the  rela¬ 
tionship  between  estimated  training  costs  and  alternative 
costs.  If  it  can  be  shown,  with  a  preselected  confidence 
coefficient  of  (1-a) ,  that  0^  >  1»  then  it  can  be  concluded 
that  a  positive  linear  relationship  exists  between  the  esti¬ 
mated  training  cost  and  the  alternative  cost,  the  first 
Research  Proposition.  The  symbol  a.  denotes  the  probabi¬ 
lity  of  concluding  3^  >1  when  actually  3^ < 1  (10:266). 

The  conclusion  of  >  1  is  critical  for  supporting  the 
first  Research  Proposition.  Thus,  it  is  undesirable  to 
conclude  3^  >  1  when  3^  <  1,  as  this  would  falsely  support 
the  first  Research  Proposition.  The  confidence  coeffi¬ 
cient  (1  -a)  is  the  probability  of  not  making  the  above 
mentioned  error.  Therefore,  the  confidence  coefficient  is 
a  measure  of  the  "confidence"  in  the  conclusion  of 

3  >i 

1 

The  second  Research  Proposition  is  dependent  upon 
the  region  of  the  graph  in  which  the  function  lies?  that  is, 
the  proposition  is  only  valid  for  Y  >  X,  illustrated  in 
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Figure  8  by  the  solid  portions  of  the  lines.  In  the  region 
described  by  the  dashed  lines,  it  would  be  more  cost  effec¬ 
tive  to  implement  the  alternative.  Therefore,  the  second 
Research  Proposition  is  only  valid  for  the  first  outcome 
and  the  region  of  the  second  and  third  outcomes  above  the 
line  Y  *  X.  Hence,  the  secor.d  Research  Proposition  is 
dependent  upon  the  values  of  Bg  and  3^. 

For  8g,  the  two  hypotheses  for  the  decision  rule 


are: 


V 


B0  >  0 


EQ.4 


The  action  limit  for  the  decision  rule  is: 


A  *  0  +  t (!-<*;  N-2)  s(bQ) 


EQ.5 


The  t  statistic  is  found  in  statistical  tables  and  s(bg), 
the  standard  deviation  of  the  estimator  for  Bg,  is  calcu¬ 
lated  in  Appendix  H-5.  The  decision  rule  for  Bg,  using 
its  point  estimator  bg,  is: 

If  bn  -  A,  conclude  Hfl 

EQ. 

If  bg  >  A,  conclude 

Concluding  would  infer  that  6^  >  g. 
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Similarly  for  3^  the  two  hypotheses  for  the  deci¬ 
sion  rule  are: 


> 


1 


EQ.7 


The  action  limit  for  the  decision  rule  is  shown  in  EQ.8, 


A  ■  1  +  t(l-a?  N-2)  s  (bx)  EQ.8 

and  the  decision  rule  is  shown  in  EQ.9. 


If  b.  -  A,  conclude  Hn 

1  u  EQ.9 

If  >  A,  conclude 

Concluding  would  infer  that  8^^  >  1. 

If  3^  -  1,  an  additional  test  would  be  required 
to  determine  if  3 ^  >  0;  this  test  would  make  inferences  on 
the  first  Research  Proposition.  Inferences  about  the 
second  Research  Proposition  would  depend  upon  which  out¬ 
come  in  Figure  8  is  concluded,  as  previously  described. 

External  Validation 

If  the  first  Research  Proposition  is  accepted,  the 
next  and  final  step  in  the  research  is  validating  the 
model  using  sample  data  from  subsequent  years.  In  the 
demonstration  which  follows  in  Appendix  H,  fictitious  data 
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for  PY79  are  proposed  for  the  Regression  procedure  and  PY80 
data  are  proposed  for  the  external  validation  of  the  model. 
Prediction  intervals  are  computed  for  each  of  the  FY80  esti¬ 
mated  training  cost  observations.  The  proposed  values  of 
the  cost  of  associated  alternatives  for  FY80  are  then  tested 
against  the  computed  prediction  intervals;  the  final  results 
are  provided  in  Appendix  H-9.  In  reality,  this  validation 
step  may  be  limited  to  providing  an  indication  of  validity, 
as  data  availability  may  preclude  drawing  any  firm  conclu¬ 
sions  about  the  model,  which  is  the  case  in  this  example. 

It  is  also  pointed  out  that  inferences  can  only  be 
made  about  X  values  which  lie  within  the  range  of  data 
used  to  generate  the  model.  Inferences  must  be  applied 
with  considerable  judgment  if  obtained  with  the  model  for 
values  of  X  substantially  outside  the  scope  of  the  model 
(10:485).  This  point  is  further  discussed  when  the  con¬ 
cept  of  updating  the  model  is  presented  in  the  procedure 
conclusions.  Appendix  H-2. 


Assumptions 

The  fallowing  assumptions  apply  to  this  procedure: 

1.  The  relationship  between  estimated  training 
cost  and  alternative  cost  established  for  past  data  is 
representative  of  future  years.  Inflation  and  advance¬ 
ments  in  technology  will  have  the  same  effects  on  both 


costs,  such  that  the  statistical  relation  remains 
representative. 

2.  Any  assumptions  made  by  AFLC  logistics  centers 
in  determining  alternative  costs  extend  to  this  procedure. 

3.  The  assumptions  associated  with  the  residuals 
o£  the  linear  regression  model  also  apply: 

a.  Linearity 

b.  Constancy  of  variance 

c.  Normality 

d.  Independence 

The  assumptions  of  linearity,  constancy  of  variance,  and 
normality,  however,  are  tested  in  the  evaluation  of 
the  aptness  of  the  model. 

Limitations 

The  following  limitations  apply  to  this  procedure: 

1.  Findings  are  limited  to  application  to  Type  1 
training  requirements  of  AFLC  only,  unless  other  command 
program  inputs  are  included  in  the  analysis. 

2.  The  model  is  only  relevant  to  the  alternatives 
included  in  the  analysis,  that  is  contractor  support, 

CETS,  etc. 

3.  The  external  validation  of  the  model  is 
limited  by  data  availability. 

4.  The  model  is  only  applicable  for  values  of  X 
within  the  range  of  data  used  in  the  regression  procedure. 


Considerable  judgment  should  be  used  in  making  inferences 
when  the  estimated  training  cost  is  substantially  outside 
the  scope  of  the  model. 
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APPENDIX  H-l 


INTRODUCTION  AND  SAMPLE  DATA 


This  appendix  is  provided  to  demonstrate  the  appli¬ 
cation  of  the  statistical  model  proposed  in  Appendix  G  and 
serves  as  a  working  example  which  may  be  used  in  future 
research.  Computer  input  and  output  listings,  applicable 
computations,  and  an  interpretation  of  the  results  are 
included  in  the  following  appendices.  Hypothetical  repre¬ 
sentative  data  generated  for  the  demonstration  are  listed 
below  and  represent: 

1.  The  costs  for  28  APLC  FY79  unfunded  training 
programs  and  the  associated  cost  of  alternatives  imple¬ 
mented  by  AFLC  as  a  result  of  no  training,  and 

2.  The  cost  for  seven  AFLC  FY80  unfunded  training 
programs  and  the  associated  cost  of  alternatives  imple¬ 
mented  by  AFLC  as  a  result  of  no  training  (for  external 
validation) . 


Estimated  Cost  of  Training 


Alternative  Cost 
(Cost  Impact) 


175 

1200 

247 

1280 

364 

1360 

443 

1800 

485 

1675 

579 

•  1850 

770 


2540 


APPENDIX  H-2 

ANALYSIS  AND  CONCLUSIONS 
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The  data  analysis  process  begins  with  a  determination 
of  the  aptness  of  the  model.  This  is  done  through  an  analy¬ 
sis  of  a  residual  scattergram  for  the  assumptions  of 
linearity  and  constancy  of  variance  and  through  the  use  of 
the  K-S  test  statistic  for  the  assumption  of  normality  of 
the  residuals.  The  residual  scattergram  and  the  K-S  test 
statistic,  provided  by  the  program  listed  in  Appendix  H-6, 
are  provided  as  Appendix  H-7.  The  data  analysis  process 
continues  with  inferences  about  6g  and  using  selected 
Regression  procedure  output  provided  as  Appendix  H-4. 

Finally,  the  external  validation  of  the  model  is  tested 
through  prediction  intervals  applied  to  FY80  data. 

Aptness.  Aptness  is  of  primary  concern  because 
all  subsequent  analysis  of  and  inferences  from  the  model 
depend  on  it  being  valid.  As  pointed  out  in  Appendix  G, 
the  four  assumptions  of  the  linear  regression  model  are 
linearity,  constancy  of  variance,  independence  of  the 
residuals,  and  normality  of  the  residuals. 

Determination  of  linearity  is  a  subjective  deci¬ 
sion  based  on  the  residual  scattergram  shown  in  Appendix 
H-7.  The  apparent  randomness  of  the  plotted  points  indi¬ 
cates  a  linear  relationship  between  X  and  Y. 

Whether  or  not  the  residual  variance  is  constant 
is  another  subjective  decision  based  on  the  residual 


scattergram.  Nonconstant  variance  would  be  indicated  by 
an  increasing  or  decreasing  trend  of  the  residuals  (see 
Figure  6) .  There  is  no  apparent  trend  on  the  scattergram; 
therefore,  the  implication  is  constant  variance. 

Independence  of  the  residuals  is  assumed.  The 
reasoning  is  presented  in  the  "Tests  for  Aptness"  section 
of  Appendix  G. 

The  final  assumption  of  the  linear  regression  model 
is  normality  of  the  residuals.  The  K-S  test  using  the 
Lilliefores  test  statistic  is  used  to  infer  normality.  A 
table  of  Lilliefores  test  statistics  is  provided  as 
Appendix  H-8.  The  Lilliefores  test  statistic,  L,  for  n=28 
(number  of  observations)  and  1  -  a =.99  (99  percent  con¬ 
fidence  coefficient)  is  0.192,  by  interpolation.  The 
statistic  to  compare  with  L  is  MAX  (ABS  DIFF)  from  the  K-S 
Goodness  of  Fit  Test  in  Appendix  H-7.  The  value  of  the 
statistic  is  0.1332.  The  appropriate  decision  rule  for 
the  normality  test  is 

If  MAX (ABS  DIFF)  -  L,  conclude  normality 

EQ.  11 

If  MAX (ABS  DIFF)  >  L,  conclude  nonnormality. 

Since  0.1332  <  0.192,  normality  of  the  residuals  is  con¬ 
cluded. 

The  model  is  determined  to  be  apt  as  none  of  the 
four  assumptions  of  the  linear  regression  model  are  rejected. 
Tests  may  now  be  performed  on  the  model  parameters  in  order 
to  make  inferences  on  them.  Before  the  tests,  however,  it 
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should  be  noted  that  the  coefficient  of  determination,  r  , 
obtained  by  the  Regression  procedure  (Appendix  H-4)  of 
0.95786  indicates  a  high  degree  of  linear  statistical 
relationship  between  estimated  training  costs  and  alter¬ 
native  costs.  This  implies  that  the  relationship  derived 
should  provide  very  good  predictions  of  alternative  costs 
for  associated  estimated  training  costs,  as  initially 
desired. 


Test  for  3q.  The  two  hypotheses  for  the  decision 
rule  ares 

hq  5  e0  -  0 

EQ.  4 

Hl!  eo  >  0 

Using  a  confidence  coefficient  of  0.99,  the  action 
limit  for  the  decision  rule  is: 

A  =  0  +  t  (0. 99;  26)  (43.62027)  *  108.13465 
where  s(bg)  is  calculated  in  Appendix  H-5. 

bp  *  642.068  from  Appendix  H-4. 

Since  bQ>  A,  conclude  H^,  that  Sg  >  o. 

Test  for  3^.  The  two  hypotheses  for  the  decision 


rule  are: 


EQ.  7 


> 


1 


Again  using  a  confidence  coefficient  of  0.99,  the 
action  limit  for  the  decision  rule  is: 


A  *  1  +  t  (0. 99;  26)  (0.09153)  *  1.2269 
where  s(h^)  was  obtained  from  Appendix  H-4. 

bj^  **  2.22508  from  Appendix  H-4. 

Since  b^  >  A,  conclude  H^,  that  3^  >  1. 

Concluding  for  3Q  and  3^  infers  that  both 
Research  Propositions  are  correct.  The  first  Research 
Proposition  is  dependent  upon  31  being  greater  than  zero. 
The  second  Research  Proposition  required  that  3^  be  greater 
than  one  and  the  function  lie  in  the  region  of  the  graph 
(Figure  8)  above  the  line  Y=X.  The  above  conclusions  for 
and  61  indicate  that  outcome  1  of  Figure  8  i3  the 
representative  line  for  the  regression  function,  which  is 
estimated  by  EQ.  2  as  follows: 

Y  »  642.068  +  2.225X.  EQ.  10 

External  Validation.  The  final  step  in  the  analy¬ 
sis  is  the  external  validation  of  the  model.  Data  for 
this  step  consist  of  the  costs  associated  with  seven 
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hypothetical  Type  1  training  programs  identified  as 
unfunded  in  FY80  and  the  associated  alternative  costs. 

The  model  is  tested  by  computing  a  prediction  interval  for 
each  estimated  training  cost  and  comparing  this  interval 
with  the  proposed  alternative  cost.  The  input  data  and 
results  for  these  computations  are  provided  in  Appen¬ 
dix  H-9. 

As  indicated  in  Appendix  G,  this  validation  step 
is  limited  to  providing  an  indication  of  validity  as  the 
availability  of  data  for  FY80  precludes  any  detailed  ana¬ 
lysis  of  the  model.  The  results  in  Appendix  H-9  do  indi¬ 
cate  the  model's  validity,  as  the  actual  value  for  alter¬ 
native  cost  falls  within  the  computed  prediction  interval 
for  every  data  pair  tested. 

Conclusions 

The  analysis  of  the  hypothetical  FY79  data  implies 
that  indeed  a  positive  linear  relationship  does  exist 
between  the  estimated  cost  of  AFLC  unfunded  Type  1  training 
and  the  cost  of  alternatives  implemented  as  a  result  of  no 
training.  More  specifically,  the  cost  impact  of  imple¬ 
menting  CETS  or  continued  contractor  support  as  a 
substitute  for  an  organic  depot  capability  can  be  related  to 
the  estimated  training  cost  by  the  following  estimated 
regression  function: 


Y  *  642.068  +  2.225X 


EQ.  10 


Inferences  on  gg  and  g^  the  regression  function  coeffi¬ 
cients,  indicate  that  it  can  be  concluded  with  99  percent 
confidence  that  gg  >0  and  g^>  1.  This  conclusion  places 
the  regression  function  totally  in  the  region  of  the  graph 
(Figure  8)  where  the  alternative  costs  exceed  the  estimated 
training  costs.  This  supports  the  second  proposition;  that 
is,  it  would  be  more  cost  effective  for  the  Air  Force  to 
provide  additional  funds  to  ATC  to  satisfy  AFLC  training 
requirements  than  to  have  AFLC  implement  alternatives. 

The  validity  of  the  model,  however,  is  still  not 
established  with  certainty  as  the  availability  of  FY80 
data  permitted  only  a  demonstration  of  validity.  Also,  it 
is  important  to  reiterate  the  assumption  that  FY79  data 
are  representative  of  future  years.  Therefore,  initial 
implementation  of  the  model  by  planning  personnel  should  be 
done  with  caution  and  judgment  while  more  conclusive  evidence 
of  validity  is  collected. 

It  is  anticipated  that  the  model  may  require  updating 
as  the  effects  of  inflation  and  advancements  in  the  state-of- 
the-art  alter  the  relationship.  This  updating  process  would 
be  very  similar  to  that  used  in  this  demonstration,  with  FY79 
data  replaced  by  more  current  data.  The  use  of  more  current 
data  would  also  extend  the  range  of  usefulness  of  the  model 
in  a  changing  economy.  Recalling  the  point  made  under 
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"External  Validation”  in  Appendix  G,  inferences  about 
alternative  costs  can  only  be  made  about  X  values  which 
lie  within  the  range  of  data  used  to  generate  the  model. 
Therefore,  updating  the  model  will  help  to  ensure  that  the 
range  of  values  of  X  for  which  the  model  is  valid  is 
representative  of  then  year  estimated  training  costs.  It 
is  emphasized  that  inferences  must  be  applied  with  con¬ 
siderable  judgment  if  obtained  with  the  model  for  values 
of  X  substantially  outside  the  scope  of  the  model 


APPENDIX  H-3 

SPSS  REGRESSION  PROCEDURE  PROGRAM 
AND  DATA  INPUT  FILE 
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10Q0»«S,R(SU  :,8,16; 16 
1 005* : IDENT :UP1 1 86, AF IT/SISC  J  ALLEN  80 
1010*: SELECT :SPSS7 SPSS 

1015RUN  NAME  REGRESSION  ANALYSIS  FOR  THESIS  DATA 
1O20VARIABLE  LISTjESTCOST ,ALTCOST 
1025INRUT  FORMAT JFREEFIELD 
1030INPUT  MEDIUMJCARD 
1035N  OF  CASES; 28 

1036L1ST  CASES ;CASES=28/ VAR  I ABLES=EST COST ,ALTCOST/ 
1040REGRESSIGNJ VARI ABLESsES7COST ,AL7COST7 
1045 REGRESSION2 ALT COST  UITH  ESTC0ST<2)  RES1D-0 
1050STATISTICS; 1 ,2, 4, 5, 6 
1055READ  INPUT  DATA 
1 056*:SEL£CTA:80A054/TRAIN,R 
IHOSCATTERGRAMJALTCOST  UITH  ESTCOST 
11410PTI0NS;? 

1 160FINISH 
11653:ENDJ0B 


100 

100 

700 

110 

125 

710 

120 

145 

1100 

130 

186 

1000 

140 

220 

1200 

150 

231 

1200 

160 

245 

1100 

170 

265 

1100 

180 

272 

1250 

170 

300 

1470 

200 

325 

1400 

210 

343 

1260 

220 

370 

1440 

230 

378 

1650 

240 

404 

1640 

250 

415 

1600 

260 

460 

1700 

270 

480 

1540 

280 

525 

1850 

270 

560 

1780 

300 

600 

2100 

310 

640 

2100 

320 

650 

2200 

330 

680 

2150 

340 

724 

2250 

350 

746 

2160 

360 

780 

2300 

370 

818 

2500 
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APPENDIX  H-4 

SPSS  REGRESSION  PROCEDURE 
SELECTED  OUTPUT 


AOVS, COLUMNS  V  VALUES  OUTSIDE  (•1.1,1.11  SOUS, COLUMNS  <  VALUES  la 


APPENDIX  H-5 
COMPUTATION  OF  s(LQ) 


The  value  for  s(bg)  is  computed  from  the  following 
equation:  j 

i 

,  1 
i 

2  1 

s2(b  )  =  MSE  [±  +  Jj - - - ]  (10:479) 

l  IX,-*)2 

i  =  l  1  j 

i 

i 

Using  appropriate  data  from  the  Regression  output  in  j 

Appendix  H-4,  the  value  for  MSE  is  found  on  page  119  under  \ 

i 

the  dual  headings  MEAN  SQUARE  -  RESIDUAL.  The  value  for  X 

i 

is  found  on  page  118  under  the  dual  headings  MEAN-ESTCOST.  | 

The  values  for  the  constant  variables  are  listed  below  > 

2  ! 

along  with  the  calculuated  values  for  s  (bQ)  and  s(bQ).  j 

(. 

N  =28  (number  of  cases)  | 

i 

MSE  =  10287.028 

X  =  428.107 

s2(bQ)  =  1,902.728 

and 

s (bg)  =  43.62027. 
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APPENDIX  H-6 

SPSS  SCATTERGRAM/K-S 
TEST  PROGRAM 
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1000#HS,R(SL)  : ,8, 16; ;  ,16 

1 005$ : IDENT :UP1 1 86, AF1T/LS  ALLEN  U1LES 

1 01 0$:SELECT: SPSS/SPSS 

1 01 SRUN  NANE;THESIS  RESIDUAL  ANALYSIS 

102QVARI ABLE  LIST JFRED.RESD 

1025INPUT  FORNATJFREEFIELD 

1030N  OF  CASESJ28 

1035SCAT7ERGRAfi;RESD(-1 75, 1 75)  UITH  PRED( 850,25001 

1040 READ  INPUT  DATA 

1045  864.577  -164.577 

1050  920.204  -10.204 

1055  964.706  135.294 

1060  1055.934  -55.934 

1065  1131.587  68.413 

1070  1156.063  43.937 

1075  1187.214  -87.214 

1080  1231.716  -131.716 

1085  1247.291  2.709 

1090  1309.594  160.406 

1095  1365.221  34.779 

1100  1405.272  -145.272 

1101  1465.350  -25.350 

1102  1483.150  166.850 

1103  1541.002  98.998 

1104  1565.478  34.522 

1105  1665.607  34.393 

1106  1710.109  -170.109 

1107  1810.238  39.762 

1108  1888.116  -108.116 

1109  1977.119  122.881 

1110  2066.122  33.878 

1111  2088.373  111.627 

1112  2155.126  -5.126 

1113  2253.029  -3.029 

1114  2301.981  -141.981 

1115  2377.634  -77.634 

1116  2462.187  37.813 

1 1  20NPAR  tesis:k-s<nornad=resd 

1125C0NDESCRIPT3VE;RESD 
1130STATISTICS;rtLL 
1135FINISH 
9999$ :END JOB 
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APPENDIX  H-7 

SPSS  SCATTERGRAM/K-S  TEST 
SELECTED  OUTPUT 
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APPENDIX  H-8 


LILLIEFOR'S  TEST  STATISTIC  TABLE 


QUANTILES  OF  THE  LILLIEFORS  TEST  STATISTIC 


p*.  80 

.85 

.90 

.95 

.99 

Sample  size  n=4 

.300 

.319 

.352 

.381 

.417 

5 

.285 

.299 

.315 

.337 

.405 

€ 

.265 

.277 

.294 

.319 

.364 

7 

.247 

.258 

.276 

.300 

.348 

8 

.233 

.244 

.261 

.285 

.331 

9 

.223 

.233 

.249 

.271 

.311 

10 

.215 

.224 

.239 

.258 

.294 

11 

.206 

.217 

.230 

.249 

.284 

12 

.199 

.212 

.223 

.242 

.275 

13 

.190 

.202 

.214 

.234 

.268 

14 

.183 

.194 

.207 

.227 

.261 

15 

.177 

.187 

.201 

.220 

.257 

16 

.173 

.182 

.195 

.213 

.250 

17 

.169 

.177 

.189 

.206 

.245 

18 

.166 

.173 

.184 

.200 

.239 

19 

.163 

.169 

.179 

.195 

.235 

20 

.160 

.166 

.174 

.190 

.231 

25 

.142 

.147 

.158 

.173 

.200 

30 

.131 

.136 

.144 

.161 

.187 

Over  30 

.736 

.768 

.805 

.886 

1.031 

/n~ 

at 

AT 

A r 

SOURCE:  3:398 


APPENDIX  H-9 
EXTERNAL  VALIDATION 


A  95  percent  two-sided  prediction  interval  for  the 
actual  alternative  cost  (Y^)  as  a  result  of  FY80  unfunded 
Type  1  training  is  computed  for  each  value  of  associated 

A 

estimated  training  cost  (Xh)  below.  (Yh  is  the  predicted 
value,  from  EQ.2). 

A 

Yh  *  Yh  +  t(l-  a/2,*  N-2)  s(dh)  (10:472) 

/v 

Yh  *  Yh  +  t  (0. 975,  26)  s(dh) 

A 

where  Yh  was  computed  for  each  value  using  EQ.  10,  and 
s(d^)  was  computed  from 


s2(d  )  =  MSE  [1  +  i  +  (*h  "  X)  ]  (10:471) 

N 

l  (X  -  X)2 
i=l  1 

using  data  from  the  SPSS  Regression  output  (Appendix  H-4) . 

The  following  listing  represents  the  FY80  esti¬ 
mated  training  costs,  the  associated  alternative  costs, 
and  the  results  of  the  above  computations: 


ALTERNATIVE  COST  ACTUAL  COMPARED  TO 
PREDICTION  INTERVAL 


(Costs  x  $1,000) 


Fiscal  Year  80 


Estimated 

Training 

Cost 

Alternative 

Cost 

(Actual) 

Alternative 

Cost 

(Predicted) 

95% 

Prediction  Interval 

175 

1,200 

1,031.458 

813.958 

-  1,248.958 

247 

1,280 

1,191.664 

976.724 

-  1,406.604 

364 

1,360 

1,451.999 

1,239.436 

-  1,664.563 

443 

1,800 

1,627.781 

1,415.541 

-  1,840.020 

485 

1,675 

1,721.234 

1,508.744 

-  1,933.725 

579 

1,850 

1,930.392 

1,716.280 

-  2,144.504 

770 

2,540 

2,355.383 

2,133.625 

-  2,577.141 

NOTE:  In  all  cases  demonstrated,  actual  alternative  cost 
is  within  the  computed  prediction  interval. 
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APPENDIX  I 

AUTOVON  DIRECTORY  FOR  OFFICES  REFERENCED 
IN  THIS  RESEARCH 
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Office  Symbol 

Personnel  Referenced 

Autovon 

AFALD/CV 

Maj  General  Charles  L.  Wilson 

785-6314 

AFLC/CC 

General  Bryce  Poe,  II. 

787-6033 

AFLC/DPCT 

Spencer  N.  Roads,  GS-14 

Russell  E.  Henss,  GS-13 

Thomas  J.  Vacchiano,  GS-9 

787-4483 

AFLC/LOMAT 

Robert  S.  Darden,  GS-12 

787-2526 

AFLC/MAJA 

John  F.  Stallings,  GS-12 

787-7771 

AFLC/MASR 

Major  Donald  A.  Mates 

787-4687 

ATC/CC 

General  John  W.  Roberts 

487-5512 

ATC/CV 

Maj  General  Evan  W.  Rosencrans 

487-5512 

ATC/TT 

Brig  General  Mele  Vojvodich,  Jr. 

487-4521 

ATC/TTY 

Colonel  Robert  F.  Brodman 

487-3366 

ATC/TTYA 

Lt  Colonel  Dale  L.  Norman 

Jackie  R.  Stewart,  GS-12 

487-3176 

OC-ALC/DPCT 

Max  D.  Hire,  GS-12 

735-7537 

OO-ALC/DPCT 

Jack  V.  Smith,  GS-13 

458-7665 

SA-ALC/DPCT 

Leroy  E.  Sebesta,  GS-11 

945-7504 

SM-ALC/DPCT 

Barry  G.  Hillier,  GS-12 

633-6294 

USAF/MPPT 

Colonel  Donald  F.  Brackett 

225-2445 

WR-ALC/DPCT 

Leverett  S.  Reed,  GS-12 

468-2092 
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